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Preface 


The  purpose  of  this  research  project  was  to  develop  a  body  of 
khowl^ge  for  the  field  of  acquisition  program  management  in  the 
Department  of  Defense  (DoD).  The  Defense  Body  of  Knowledge  (DBOK)  is  a 
doTipilation  of  all  knowledge  areas  that  a  program  manager  must  know  and 
understand  to  be  effective.  By  defining  the  knowledge  requirements  the 
DBOK  is  the  necessary  first  step  toward  establishing  DoD  acquisition 
management  as  a  profession. 

This  research  used  four  methods  to  develop  and  validate  the  DBOK: 
1)  an  exhaustive  review  of  literature  on  the  field  of  project 
managem^t,  2)  curricula  review  of  educational  institutions  in  the  DoD 
that  teach  defense  acquisition  managanent,  3)  expert  review,  and  4)  a 
survey  administered  to  the  recognized  experts  in  the  field.  The 
resulting  DBOK  is  a  validated  foundation  of  the  acquisition  program 
management  profession,  but  continuing  review  and  development  is 
necessary  to  ensure  that  it  is  accepted  across  the  profession  today  and 
in  the  future. 

The  researchers  took  counsel  from  several  people;  without  their 
help  the  DBOK  would  not  have  been  developed.  Primarily  we  would  like  to 
thank  our  advisor,  Dr.  Curtis  "Don't  Call  Me  Sir  Anymore"  Cook  at  the 
Project  Management  Institute,  for  his  direction  and  patience  throughout- 
this  project.  Finally,  the  DBOK  would  not  have  been  possible  without 
the  efforts  of  Dr.  Owen  Gadeken  at  the  Defense  Systems  Management 
College;  to  him  we  are  indebted. 


Gregory  D.  Best 
Ko  r  1  na  L .  Koby  1  a  r  r. 
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Abstract 


This  research  project  developed  a  common  body  of  knowledge  for  the 


field  of  acquisition  program  management  in  the  Department  of  Defense 
(DoD).  The  Defense  Program  Managament  Body  of  Knowledge  (DBOK)  is  a 
compilation  of  all  knowledge  areas  that  a  program  manager  must  Imow  and 
imderstand  to  be  effective.  Three  methods  were  used  to  develop  a 
hypothetical  model  DBOK:  1)  an  exhaustive  review  of  project  management 
literature,  2)  curricula  review  of  DoD  acquisition  management 
educational  institutions,  and  3)  expert  review.  The  hypothetical  model 
was  validated  with  a  survey  administered  by  the  Project  Management 
Institute  to  all  directors  and  deputy  directors  of  Major  Defense 
Acquisition  (Category  I)  prograjis  in  the  DoD.  Of  148  surveys  mailed,  53 
were  returned  for  a  response  rate  of  36%.  The  survey  results  prioritize 
all  el  aments  of  the  DBOK  and  ideni.ify  acute  training  needs  of  the 
respondents.  The  resulting  DBOK  is  a  validated  knowledge  baseline  foi 
the  acquisition  program  management  profession.  As  such,  it  is  a 
suitable  standard  for  accrediting  DoD  pregram  management  educational 
institutions  that  teach  DoD  program  management ,  and  for  certification  of 


program  managers  across  the  DoD.  The  DBOK  miu3t  now  be  sui>jec*-ed  to 
profe-ssional  review  and  criticism  to  ensure  its  continuing  applicabilii / 
and  acceptance  throughout  the  profession. 
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ESTABLISHING 

A 

DEPARTMENT  OF  DEFENSE 
PROGRAM  MANAGEMENT  BOOT  OF  KNOHLEDGE 

'I .  Introduction 

General  Issue 

The  Department  of  Defense  (DoD)  is  one  of  the  most 
complex  organizations  in  the  United  States.  It  employs 
nearly  10  million  Americans  (almost  10%  of  the  total 
American  workforce),  executes  over  50  million  contracts  per 
year,  and  spends  between  $250  and  $300  billion  annually. 

The  goal  of  this  effort  and  spending  is  the  development  and 
ul timate *depl oyment  of  some  of  the  most  unique  and  complex' 
systems  in  the  world  (12:5). 

Acquiring  and  deploying  systems  with  the  size  and 
complexity  required  by  the  DoD  poses  unique  and  difficult 
problems  for  the  DoD  program  manager.  In  order  to 
ef fectively -meet  and  counter  these  problems,  DoD  program 
managers  must  be  experienced,  wel 1 -trained ,  and  educated. 
Deficiencies  have  been  noticed,  however,  in  both  the 
education  and  training  of  the  DoD  acquisition  workforce. 

Due  largely  to  these  deficiencies,  system  schedules  and 
costs  have  been  underestimated,  stated  requirements  have  not 
been  adequately  met,  and  the  American  public  has  begun  to 
doubt  the  ability  of  DoD  to  effectively  acquire  needed 
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systems.  This  public  doubt  is  not  without  substance  for,  in 
general,  DoD  has  not  developed  and  maintained  a  project 
.management  workforce  which  possesses  the  acquisition-related 
education  and  training  required  to  solve  the  unique 
acquisition  problems  facing  the  DoD  today  (12:31-39). 

One  major  reason  for  the  noted  deficiencies  in  both  the 
training  and  education  of  DoD  project  managers  is  the  lack 
of  a  common  DoD  project  management  body  of  knowledge  (DBOK). 
To  date,  there  is  no  standardized,  comprehensive  listing  or 
publication  of  the  information  an  individual  must  know  and 
understand  in  order  to  perform  effectively.  As  a  result,  no 
DoD-wide  project  management  certification  program  exists, 
although  some  services  do  have  specific  certification 
programs.  A  comprehensive  body  of  knowledge  would  provide 
DoD  with  the  baseline  for  developing  a  professional 
workforce  which  is  well-educated  and  possesses  the 
information  needed  to  perform  effectively. 

Objective 

The  objective  of  this  paper  is  to  define  and  validate  a 
defense-specific  project  management  body  of  knowledge  which 
is  sufficiently  comprehensive  to  include  those  project 
managerial  practices  which  every  professional  DoD  project 
manager  must  know  and  understand  in  order  to  perform 
effectively . 
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Scope  of  Research 


This  thesis  will  define  the  knowledge  necessary  for  a 
DoD  project  manager  to  perform  effectively.  A  list  of 
knowledge  areas  will  be  developed,  then  validated  by 
soliciting  input  from  all  directors  and  deputy  fli“actors  of 
major  DoD  acquisition  programs.  Their  input  will  be  cross- 
referenced  with  the  original  product  and  changes  will  be 
made  where  appropriate. 
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I I .  Background 


introductidh 

This  section  will  discuss  the  field  of  project 
management  from  the  perspectives  of  the  project  manager,  the 
organizational  structure  within  which  project  management 
bperates,  and  the  history  of  project  management.  Finally, 
the  profession  of  project  management  will  be  discussed.  To 
begin  this  section  it  is  necessary  to  define  the  "project." 

Definition  of  a  Project 

Since  project  managers  are  concerned  with  the 
management  of  projects,  it  is  essential  that  one  adequately 
understands  what  a  project  is,  and  what  makes  ai  project 
unique  from  other  management  endeavors,  before  trying  to 
unravel  the  complexities  existing  for  the  effective  project 
manager. 

Acquiring  a  sound  and  thorough  definition  of  a  project 
is  in  itself  a  difficult  task,  for,  like  any  abstract 
concept,  various  authors  and  experts  in  the  field  of  project 
management  define  the  term  in  a  variety  of  ways.  For 
example,  Kerzner,  in  his  text  Project  Management:  h  Systems 
Approach  to  Planning,  Scheduling,  and  Controlling,  defines  a 
project  as: 
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Any  series  of  activities  and  tasks  that: 

•  Have  a  specific  objective  to  be  completed  within 
certain  specifications 

•  Have  defined  start  and  end  dates 

•  Have  funding  limitations  (if  applicable) 

•  Consume  Resources  (i.e.  money,  people,  equipment). 
(14:2-3) 

Meredith  and  Mantel,  in  their  text  Project  Management:  a 

Managerial  Approach,  present  a  much  more  in-depth  definition 

qt  a  project  then  does  Kerzner.  Meredith  and  Mantel  break  a 

project  into  three  separate  phases,  consisting  of  Project 

Initiation,  Implementation,  and  Termination  (19:10-11). 

Another  definition  can  be  gained  from  Dr  David  Cleland,  in 

his  text  Project  Management  Strategies:  Design  and 

Implementation .  Here  Dr  Cleland  defines  a  project  as: 

...any  undertaking  that  has  definite,  finite  objectives 
repres.enting  specified  values  to  be  used  in  the 
satisfaction  of  some  desire... a  project  consists  of  a 
combination  of  organizational  resources  pulled  together 
to  create  something  that  did  not  previously  exist  and 
that,  will  provide  a  performance  capability  in  the 
design  and  execution  of  organizational  strategies.  A 
project  has  a  distinct  lifecycle,  starting  with  an  idea 
and  progressing  through  design,  engineering,  and 
manufacturing  or  construction  through  use  by  a  project 
owner.  (4:11-12) 

Other  sources  will  define  the  project  differently,  but 
the  essence  of  each  definition  is  the  same.  The  definition 
of  a  project  which  captures  this  "common  essence"  in  a 
manner  most  easily  understood  comes  from  the  Project 
Management  Institute's  (PMI's)  Project  Management  Body  of 
Knowledge  (PMBOK).  The  PMBOK's  definition  of  a  project  is 
as  follows: 
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Any  undertaking  with  a  defined  starting  point  and 
defined  objectives  by  which  completion  is  identified. 
In  practice,  most  objectives  depend  on  finite,  or 
limited  resources,  by  which  the  objectives  are  to  be 
acfcomplished.  -,(21:1«1) 

From  this  definition  it  can  be  seen  that  an  essential 
element  of  any  project  is  to  bring  about  change  and  project 
managers  must,  in  turn,  effectively  manage  that  change. 
Because  of  this  continuous  change,  the  management  of 
projects  is  especially  difficult.  In  order  to  be 
(effectively  conducted,  the  task  must  be  accomplished  by  a 
trained  and  experienced  professional:  the  project  manager. 
Cleland  states  that  project  management  is  an  approach  for 
responding  to  the  dynamic  nature  of  the  project  throughout 
it's  lifecycle  in  an  organization.  To  deal  with  comple:< 
p.rojects,  tailored  strategies  are  required  that  are  often 
simple  but  are  rarely  obvious  to  the  manager.  To  develop 
such  strategies,  and  to  solve  subsequent  problems,  there  is 
a  need  to  develop  management  techniques  and  devices  which 
address  themselves  to  the  dynamic  nature  of  projects  (4:34) 
From  here  it  can  be  seen  that  the  simplest  definition  of  th 
project  manager's  role  understates  tie  true  responsibi 1 itie 
and  duties  of  the  project  manager.  A  much  more  in-depth 
definition  is  requi red . 

The  Role  of  the  Project  Manager 

In  order  to  define  the  proje<;t  manager's  role  one  must 
first  identify  the  functions  that  a  project  manager  is 
responsible  to  accomplish  during  the  lifecycle  of  the 
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project  (1:13).  Kerzner  states  that  a  project  manager  is 
:not  only  the  manager  of  change,  but  is  also  a  planner, 
monitor  and  controller  of  his  respective  project.  This 
includes  the  following: 

•  Complete  task  definition 

, •  Resource  requirement  definition 

•  Major  timetable  milestones 

•  Definition  of  end  item  quality  and  reliability 
(16:17) 

Meredith  and  Mancel  further  this  definition  by 
including  administrative  responsibilities,  budgeting, 
staffing,  organizing,  and  coordinating  project  matters  to 
the  list  of  responsibilities  of  the  project  manager  (19:83) 
During  the  1976  Seminar  of  the  Project  Management  Institute 
in  Houston,  Texas,  the  important  functions  of  the  project 
manager  were  defined  as: 

•  Planning  and  Scheduling 

•  Performance  Analysis 

•  Progress  Reporting 

•  Maintaining  Cl ient/Consul tant  Relations 

•  Project  Trend  Analysis 

•  Cost  Trends  Analysis 

•  Logistics  Management 

•  Cost  Control 

•  Organization  and  Manpower  Planning 

•  Maintaining  the  Technical /Business  Interface 

•  Contract  Administration 

•  Controlling  materials  and  Manpower 

•  Estimating  and  Procedure  Writing 

•  Administration 
(1:13) 

Although  none  of  these  lists  is  comprehensive,  it  can 
be  seen  that  the  project  manager  has  a  variety  of 
responsibilities  and  is  the  central  point  around  which  the 
project  revolves.  With  this  in  mind,  and  using  information 
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from  the  experts  in  the  field  for  guidance,  a  definition  of 
"the  project  manager"  can  be  attempted.  Adams,  in  his 
pamphlet,  "Roles  and  Responsibilities  of  the  Program 
Manager,"  defines  a  project  manager  as  a  multi-dimensional 
-person  who  possesses  skills  which  include,  but  are  not 
limited  to: 

Integrator:  Since  the  project  manager  is  the  only 

person  who  is  able  to  view  the  entire  project  and  see 
how  it  is  to  fit  into  the  overall  plan  of  the 
organization,  it  is  essential  that  the  project  manager 
.  coordinate  all  the  efforts  of  his  team  into  a  workable 
unit  towards  accomplishing  the  project  goals.  The 
project  manager  must  "integrate"  the  work  being  done 
within  with  the  work  being  done  outside  the 
organization  to  ensure  success  and  compatibility. 

Communicator:  Information  comes  to  the  project  manager 

from  various  sources  and  the  project  manager  must  be 
able  to  funnel  this  information,  in  a  manner 
understandable  to  the  team  members,  in  order  to  ensure’ 
success. 

Team  Leader:  The  project  manager  must  be  able  to  solve 
problems  as  they  arise  and  to  guide  people  from 
different  functional  areas  towards  the  accomplishment 
of  the  project  goal. 

Decision  Maker:  Decisions  will  vary  according  to  the 
type  of  the  project  and.  the  lifecycle  stage,  but  the 
project  manager  must  make  them. 

Climate  Creator  or  Builder:  An  atmosphere  must  be 
created  in  which  the  team  members  can  work  together 
without  hinderance.  It  must  be  supportive  and 
conflicts  and  unre.st  must  be  avoided, 

Another  definition  of  the  role  of  the  project  manager 
is  given  by  Kerzner  who  states  that,  "A  project  manager  is 
one  who  plans,  schedules,  directs  and  controls  company 
resources  for  a  relatively  short  period  of  time  during  which 
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established  and  specified  goals  and  objectives  are  being 
accomplished"  (14:2). 

From  these  definitions  it  can  be  seen  that  the  project 
manager  is  in  charge  of  total  project  planning  and 
monitoring  including  such  items  as: 

•  Project  Planning 

-  Defining  work  requirements 

-  Defining  quantity  of  work 

-  Defining  resources  needed 

•  Project  Monitoring 

-  Tracking  progress 

-  Comparing  actual  to  predicted  progress 

-  Analyzing  impact 

-  Making  adjustments 
(15:2-3) 

"Successful"  project  management  can  therefore  be  defined  as 
applying  resources  to  reach  the  project  objectives: 

•  Within  time 

•  Within  budgeted  cost 

•  At  the  desired  perf ormance/technol ogy  level 

•  While  satisfying  customer  or  user  expectations  of 
quality  ' 

(15:3) 

These  criteria  are  displayed  in  Figure  1. 


Project  Organization' 

Project  management  uses  a  systems  approach  in  which 
functionally  organized  personnel  (vertical  Hierarchy)  are 
assigned  to  a  specific  project  (horizontal  hierarchy)  as 
shown  in  Figure  2  (14:2).  Such  a  structure  is  commonly 
referred  to  as  a  "matrix"  structure.  The  typical  preferred 
relationship  between  the  project  manager  and  the 
functional  managers  is  shown  in  Figure  3.  The  functional 
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FIGURE  1;  Criteria  for  Successful  Project  Management. 
(16:5) 


FIGURE  2:  The  Matrix  Organizational  Structure.  (16:116) 
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manager  is  usually  the  technical  expert,  relied  upon  by  the 
project  manager  for  guidance  and  assistance. 


FIGURE  3:  The  Relationship  Between  the  Project  Manager  and 
Functional  Managers.  (15:112) 

Resources.  The  total  resources  available  to  the 
organization  are  money,  personnel,  equipment,  facilities, 
materials,  and  inf ormation/ technol ogy  (16:7).  Despite  the 
project  manager's  span  of  control  over  the  project,  he 
typically  controls  none  of  these  resources.  The  project 
manager  only  identi ties,  the  resource  requirements  of  the 
project.  The  functional  managers  and  top  management 
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maintain  control  over  the  resources  of  the  organization  and 
assign  them  to  the  project.  The  project  manager  must 
therefore  negotiate  with  the  functional  managers  and  top 
management  for  project  resources.  This  relationship  is 
illustrated  in  Figure  4  (16:10). 
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FIGURE  4:  The  Project  Manager's  Negotiating  Activities. 
(15:11) 


Project  Personnel.  When  the  resources  in  question  are 
the  members  of  the  project  team,  the  project  manager's 
authority  is  delicately  balanced  with  that  of  the  functional 
managers  who  retain  ultimate  control  over  their  people.  The 
exact  balance  varies  between  organizations  and  even  between 
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individual  managers  within  organizations,  but  the  common 
‘theme  is  duality.  Each  member  of  the  project  team  works  for 
two  bosses.  The  functional  managers  may  write  performance 
evaluation  reports  and  control  compensation,  while  the 
project  manager  directs  the  daily  tasks  of  the  team 
(19,121). 

Based  on  the  above  characteristics  of  the  matri.H 
organization,  the  successful  project  manager  depends 
strongly  on: 

•  Good  daily  working  relationships  with  the  functional 
iT.anagers  who  directly  assign  resources  to  the  project 
and  provide  technical  guidance  to  the  project  manager. 

•  Communication , ski 1  Is .  The  project  manager  must  deal 
with  others  and  effectively  manage  various  interactions 
at  ai'  levels  through  effective  communication  skills. 
(4:21; 

•  Negotiating  skills  for  soliciting  project  resources. 
As  M'ei'odith  and  Mantel  put  it,  "Success  is  doubtful  for 
a  ?M  without  strong  negotiating  skills."  (17:121) 

•  Motivation  skills  to  encourage  quality  output  from 

subordinates  of  other  managers.  (19:91-92) 

« 

Evolution  of  Project  Management 

Project  manao'emeiiv  is  not  a  new  concept.  Establishing 
a  project  as  a  meant  to  an  end  has  been  around  for  thousands 
of  years  ( 21 ;  Foreword )  .  Bct.i  the  Pyramids  of  Egypt  and  the 
Great  Wall  of  China  can  be  cited  as  early  e.xamples  of 
projects.  These  were  no  doubt  prolonged  and  complex 
activities  which  exhibited  many  managerial  and  production 
difficulties. 
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What  is  new  to  the  field  of  project  management  is  the 
;rapidly  changing  business  environment.  The  field  of  project 
management  today  is  a  much  more  complex  and  diverse 
discipline  then  it  was  in  the  past  and  because  of  this  it  is 
even  more  essential  now,  than  it  has  been  in  the  past,  that 
this  change  is  brought  about  as  effectively  and  efficiently 
as  possible  {21;1«1).  To  help  accomplish  this,  project 
management  has  many  innovative  approaches  to  both  management 
restructuring  and  the  adoption  of  special  management 
techniques  (14;1). 

The  Changing  Management  Environment.  Four  trends  have 
led  to  the  advent  of  project  management.  These  trends  are: 

1.  Increasing  rates  of  technical  innovation,  its 
dissemination  and  adoption,  which  tend  to  decrease  the 
life  cycle  of  the  production  process. 

2.  Price/Profit  reductions  from  increased  competition 
and  technological  complexity. 

3.  Increase  in  the  demand  for  trained  and  experienced 
professionals  and  specialists  in  all  phases  of  the 

‘  project  lifecycle. 

4.  Decreased  timeframe  in  which  to  accomplish  the 
project  successfully.  (20:2)- 

In  response  to  the  trends  mentioned  above, 

. . .management  was  "forced"  into  organizational 
restructuring  because  the  traditional  organizational 
form  which  had  survived  so  many  decades  was  now  found 
to  be  inadequate  to  integrate  activities  across 
functional  boundaries.  (14:19) 

These  functional  boundaries,  when  superimposed  on  the 
"prestige"  gaps  between  management  layers,  create 
operational  islands  within  the  firm  which  operate 
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autonomously  ahd/or  hoard  information  for  fear  of  losing 
power.  Figure  5  illustrates  this  problem.  Restructuring 
into  a  project  approach  was  usually  successful  at 
integrating  these  operational  islands  back  into  the  firm. 
(14:19-20) 


Structures.  (16:5) 


Advantages  of  Project  Management.  As  a  result  of  the 

four  trends  mentioned  above,  four  additional  forces  drive 

organizations  toward  the  employment  of  project  management: 

1.  The  rate  of  change  within  the  business  environment 
is  increasing  and  project  management  is  more  responsive 
and  adaptable  to  this  change  than  other  management 
paradigms. 
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2,.  Increased  complexity  allows  the  project  manager  to 
effectively  use  the  expertise  of  many  people  from 
ya.ri6us  disciplines. 

3.  the  project  manager  is  able  to  focus  his  attention 
on  the  project  and  thus  is  able  to  minimize  the  amount 
of  risk  present  throughout  the  lifecycle  of  the 
project . 

4.  Project  management  allows  for  successful  allocation 
of  limited  resources.  (20:2-3) 

Project  management  is,  therefore,  an  effective  response 
to  the  changing  business  environment  that  faces  many  firms. 

The  traditional  organizational  structures,  exemplified 
by  Figure  6,  were  not  able  to  cope  with  the  rapid  rate  of 
change  in  both  technology  and  the  market  place  which  has 
characterized  the  past  twenty  years.  This  rate  of  change 
has  created  enormous  strains  upon  existing  organizational 
forms.  The  traditional  management  structure  is  highly 
bureaucratic,  and  experience  has  shown  that  it  can  not 
respond  rapidly  to  a  changing  environment.  Thus  the 
traditional  structure  must  be  replaced  by  project 
management,  or  temporary  management  structures  that  are 
highly  organic  and  can  respond  very  rapidly  as  situations 
develop  inside  and  outside  the  company.  (16:102-106) 

Project  management  is  a  way  to  integrate  comple.x 
efforts  and  to  reduce  bureaucracy.  It  provides  a  means  to 
ensure  both  flexibility  and  control. 

The  need  for  flexibility  has  become  apparent  since  no 
two  projects  are  ever  alike  from  a  manager's  perspective. 
There  are  always  differences  in  technology,  in  geographical 
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FIGURE  6:  The  Traditional  Management  Structure.  (16:103) 


loc'-ti-ons,  in  the  client,  in  the  contract  terms  and 
conditions,  in  the  schedule,  in  the  financial  approach  to 
the  project,  and  in  a  broad  range  of  international  factors, 
all  of  which  require  a  different  and  flexible  approach  to 
managing  each  project  (14:5). 

Growth  of  Project  Management.  Project  management  as  an 
accepted  organizational  paradigm  is  relatively  modern. 
Project  management  techniques  have  been  used  by  chemical  and 
construction  companies  since  the  1940's,  and  in  the  military 
for  many  years  (20:1),  but  most  authors  recognize  that 
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modern  project  management  practices  began  with  the  Manhattan 

Project  and  the  development  of  the  atomic  bomb  during  the 

eariy  1940’s  (19:4).  The  project  management  philosophy  used 

during  this  project  was  recognized  for  its  effectiveness; 

...with  the  advent  of  complex  military,  civilian  and 
space  systems,  the  project  approach  has  taken  on  a  new 
significance. .. it  now  appears  to  be  the  most  effective 
technique  available  for  managing  the  development  of 
large,  complex  systems  involving  many  different 
technologies  and  often  extensive  subcontracting.  (20:1) 

By  the  early  1960's,  literature  discussing  project 

management  was  published  and  experiments  were  accomplished 

by  such  companies  as  IBM  using  early  forms  of  project 

management.  In  1969  the  Project  Management  Institute  was 

established  (4:2),  and  by  the  1970’s  many  companies  joined 

with  IBM  in  their  use  of- project  managerial  disciplines 

(15:31).  During  the  1970's  and  1980's,  companies  began  to 

find  that  project  management  skills  were  a  necessity  in 

order  to  survive  in  the  market  arena.  Companies  were 

beginning  "...to  expand  into  multiproduct  lines,  many  of 

which  were  often  dissimilar,  and  organizational  complexities 

grew  almost  without  bound"  (15:31). 

Not  all  companies  needed  the  benefits  offered  by 

project  management.  However,  those  with  increasing  size  an.l 

compl  e;'.i  ty ,  tight  resource  and  performance  constraints,  much 

required  integration  due  to  the  crossing  of  various 

functional  boundaries,  and  operations  in  a  dynamic 

environment  were  prime  candidates  for  the  project  management 

approach  (16:28). 
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Yet  even  in  companies  that  did  need  project  management, 
■the  concepts  and  techniques  behind  project  management  have 
.been  slow  to  gain  widespread  acceptance  until  recently.  The 
main  reason  for  this  seems  to  be  that  project  management 
often  requires  organizational  restructuring  and  the 
relinquishment  of  a  certain  amount  of  top  managerial  power 
(16:28).  Also,  even  though  project  management  had  been 
around  for  decades,  it  was  still  misunderstood  by  many 
people  in  key  positions.  It  became  apparent,  however,  that 
the  required  restructuring  was  relatively  minimal,  and  that 
the  power  lost  provided  great  benefit  for  the  company  as  a 
whole.  To  speed  the  acceptance  of  project  management, 
organizations  such  as  PMI  were  established  to  increase  the 
general  understanding  of  the  purpose  and  advantages  of 
project  management.  Thus,  by  the  1980 's,  project  management 
had  become  widely  accepted  in  multifunctional  companies. 

The  Project  Management  Inst itute 

To  promote  the  benefits  offered  by  project  management, 
the  Project  Management-  Institute  (PMI)  was  initiated  in 
1969.  The  initial  goal  of  the  PMI  was  to,  "...advance  the 
state  of  the  art  in  the  management  of  pro jects . . . and  to 
improve  the  effectiveness  and  efficiency  of  the  management 
of  change  for  the  benefit  of  all  mankind"  ( 21 :  Preface) .  To 
accomplish  this  goal,  the  PMI  would: 

•  Foster  professionalism  in  the  management  of 

projects . 
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•'  Identify  and  promote  the  fundamentals  of  project 
management  that  are  needed  in  order  to  advance  the  body 
of  knowledge  for  managing  projects  efficiently  and 
effectively . 

•  Provide  a  re,cognized  forum  allowing  for  the  free 
exchange,  of  ideas,  applications,  and  solutions  to 
present  day  project  managerial  challenges. 

•  Stimulate  the  application  of  project  management  to 
the  benefit  of  both  .industry  and- the  public. 

•  Provide  an  interface  between  both  users  and 
suppliers  of  the  hardware  and  software  required  to 
effectively  accomplish  project  management  systems. 

•  Collaborate  with  universities  and  other  educational 
institutions  in  an  attempt  to  encourage  the  appropriate 
educational  and  career  development  at  all  levels  in 
project  management. 

•  Encourage  an  increased  amount  of  academic  and 
industrial  research  in  the  field  of  project  management. 

•  Foster  contacts  with  other  public  and  private 
organizations  that  relate  to  the  field  of  project 
management,  and  cooperate  in  matters  of  common  interest 
with  project  managers.  (4:3) 

Project  Management  as  a  Profession.  To  accomplish 
this,  the  PMI  needed  to  establish  the  project  management 
field  as  a  unique  profession,  and  initiate  a  means  to 
establish  a  "professional"  project -management  workforce. 
Initially  professionalism  seems  like  an  abstract  concept 
which  can  not  be  measured  or  recorded.  However,  after 
standards  are  defined,  "...professionalism  can  be  measured 
and  therefore  delineated  within  the  constraints  of  the 
standards  as  structure.  (15:11)"  The  educational  and 
certification  program  required  to  create  "professional" 
managers  needed  to  be  tailored  to  the  unique  needs  of  the 
project  management  field.  In  order  for  this  to  be  done,  the 
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project  management  field  would  have  to  meet  five  key 
criteria.  These  criteria  delineate  the  characteristics 
required  of  a  comprehensive  and  quality  professionalism 
program.  They  are: 

1.  An  identifiable  and  independent  body  of  knowledge 
of  project  management  (Standards); 

2.  Supporting  educational  programs  by  an  accredited 
institution  (Accreditation); 

3.  A  qualifying  process  (Certification); 

4.  A  code  of  ethics,  and 

5.  An  institution  representing  members  with  a  desire 
to  serve.  (21:0«1) 

Importance  of  the.  Body  of  Knowledge.  Early  PMI  members 
realized  that  a  body  of  knowledge  would  be  required  before 
accreditation  and  certification  could  be  accomplished.  Such 
a  body'  of  knowledge  would  have  to  be  project  management 
specific.  Thus,  the  key  to  meeting  these  criteria  was  the 
development  and  ultimate  acceptance,  by  e:<perts  in  the  field 
of  project  management,  of  a  standard  Project  Management  Body 
of  Knowledge  which  contained  the  general  information 
required  of  any  effective  project  manager.  Such  a  body  of 
knowledge  would  form  the  foundation  of  the  profession 
(17:11).  The  body  of  knowledge  would  be  vised  for  many 
purposes,  "...but  most  specifically  it  would  provide  the 
common  denominator  which  binds  all  parts  of  the 
professionalism  program  together"  as  in  Figure  7  (17:12'). 


Certification  of  Project  Managers.  The  body  of 
knowledge  would  first  serve  as  the  basis  for  the  development 
of  certification  examinations.*  These  examinations  would  be 
used  as  a  feedback  tool  in  determining  how  well  the 
prospective  professional  project  manager  had  mastered  the 
terms,  concepts,  ideas,  etc  considered  important  to  the 
project  management  field  (17:12).  The  cei.  ti  f :  call  on  program 
would  in  turn  form  the  basis  of  a  recertification  program  tc 
require  that  professional  project  managers  remain  involved 
with  the  profession  and  current  with  its  growth.  Frnally, 
the  certification  process  would  provide  a  goal  and  model  for 
the  professional  development  of  neophyte  project  managers 
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who  aspire,  to  become  certified  as  professionals,  as  well  as 
certified,, pro ject  managers  who  wish  to  remain  with  the 
profession. 

Accreditation  and  Recognition  of  Education  Programs. 

•For  accreditation  and  course  recognition,  the  body  of 
knowledge  would  serve  as  a  standard  for  endorsing  university 
curricula  and  industry  training  courses  based  on  the 
information  they  provide  about  project  management  and  its 
related  disciplines.  (17:12) 

In  this  manner,  establishment  of  a  project  management 
body  of  knowledge  would  be  the  first  step  in  creating  a 
means  of  establishing  a  professional  project  management 
workforce. 

Benefits  to  Society.  A  project  management 
profession,  united  across  the  many  industries  and 
technologies  that  use  the  concepts  documented  in  the  PMEOK, 
has  a  tremendous  potential  for  improving  the  efficiency  with 
which  resources  are  used  and  hence  tne  quality  of  life 
enjoyed  by  the  citizens  of  our  society.  This  unity  can  be 
achieved  through  effective  communications  based  upon  m\itual 
understanding  of  a  documented  and  accepted  body  of  knowledge 
ti.a:  S'^rves  as  the  basis  for  developing  the  project 
management  profession.  ( 21 : Foreword ) 

With  this  in  mind,  and  with  the  hope  of  eventually 
developing  a  system  which  could  be  used  worldwide  to  train 
and  educate  potential  proj-^ct  managers,  a  committee  was 
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established  and  assigned  the  task  of  developing  what  would 
one  day  be  the  project  management  body  of  knowledge.  The 
.process  of  developing  and  obtaining  agreement  on  the  content 
of  the  body  of  knowledge  was  initiated  by  PMI  as  a  portion 
of  the  job  assigned  to  the  Ethics,  Standards,  and 
Accreditation  (ESA)  project.  (21:2»1) 

Development  of  the  PMBOK.  Early  work  and  research 
by  the  ESA  confirmed  that  there  was  indeed  a  definite  and 
.unique  body  of  knowledge  in  the  project  management  field, 
satisfying  the  first  criterion  of  a  profession.  Further 
deliberations  by  ESA  resulted  in  a  baseline  report  which  was 
presented  to  the  PMI  board  in  August  1982  (21: 2*1).  The 
report  was  published  in  the  August  1983  edition  of  the 
Project  Management  Quarterly  and  identified  six  areas  of 
concentration  which  were  necessary  for  a  body  of  knowledge 
to  represent  the  field  of  project  management.  These  initial 
si:<  areas  were: 

1.  Scope  Management 

2.  Cost  Management 

3.  Time  Management 

4.  Quality  Management 

5.  Human  Resource  Management 

6.  Communications  Management  (22:564) 

Ea::h  of  these  areas  was  then  broken  down  into  topi:s  ?.ncl 
subtopics  by  use  of  a  work  breakdown  structure. 

Once  provided  with  this  baseline,  the  P.MI  established 
two  programs  to  add  structure  to  the  profession  of  project 
management:  1)  an  accreditation  program  which  endorses 

educational  institutions  that  teach  project  managea-ne.'. '  ,  and 
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,2f)  a  certification  program  through  which  individual  project 
managers  can  qualify  for  the  title  Project  Management 
Professional  (PMP)  based  on  their  experience,  tested 
knowledge,  and  service  to  the  profession.  The  purpose  of 
these  two  programs  is  to  enhance  professionalism  in  project 
management  and  to,  "...force  project  managers  to  organize 
and  take  stock  of  their  knowledge  of  project  management, 
perhaps  for  the  first  time."  (13:557) 

The  ESA  baseline  report  was  first  compiled  into  a 
formal  document  in  1986,  and  the  first  complete  PMBOK  draft 
was  published  in  the  1986  edition  of  the  Project  Management 
Journal  (22:564).  Suggestions  and  contributions  on  the 
draft  were  solicited  from  PMI  members  and  were,  where 
appropriate,  incorporated  into  the  draft  PMBOK.  The  result 
was  the  publishing  of  the  approved,  and  present,  PMBOK  on  28 
March,  1987  (21:2).  The  1987  edition  of  the  PMBOK  contained 

three  additional  topics  which  were  not  included  in  the  1986 

« 

draft.  These  were  (continued  from  the  previous  page): 

7.  Risk  Management 

8.  Cont ract/Procurement  Managemen* 

9.  Project  Management  Framework  (18:551) 

These  three  additions  completed  the  PMBOK  that  rs  still  rn 
today. 

The  1937  PMBOK  became  effective  for  use  by  all 
profes-iional  PMI  activities  on  1  September,  1933  (  13:551  ). 


The  PMBOK  took  over  six  years  to  complete  and  was  considered 
to  be  the  cornerstone  upon  which  the  PMI  would  be  built  in 
'  the  future: 

The  effort  to  identify  and  establish  standards 
associated  with  (project  management)  follows  naturally 
from  .PMI's  primary  dedication.  It  represents  a  major 
Institute  endeavour  and  is  the  PMBOK' s  primary  purpose. 
Secondary  to  this  purpose,  but  equally  consistent  with 
PMI's  dedication,  is  to  provide  the  basis  and  support 
for  PMT  professionalism  programs,  which  include 
Accreditation,  Education  and  Certification.  (21:1»1) 

it  was  never  PMI's  intent  that  the  PMBOK  should  be  a  static 

document.  It  was  well  understood  by  the  authors  of  the 

PMBOK  that  the  field  of  project  management  is  extremely 

dynamic,  and  that  any  respective  body  of  knowledge  would 

have  to  be  equally  dynamic  in  order  to  maintain  currency. 

Yet,  the  PMBOK,  by  definition,  must  be  sufficiently 

comprehensive  to  define  the  general  practices  and  principles 

any  project  manager  must  know  to  be  effective. 

Unfortunately,  this  is  not  the  case  with  respect  to  DoD 


program  managers. 

ry-r  lying  the  PMBOK  to  DoD  Program  Management.  The 
PMBOK  does  not  meet  all  of  the  requirements  of  the  DoD  in 
defining  necessary  ski  1  1  .s  .  There  are  four  major  reasons  for 
these  knowledge  gaps: 

1.  DoD  works  under  unique  circumstances  not  presen '■  : 
other  organizations.  A  major  example  is  pervasive 
regulation  that  anyone  working  in  or  doing  business 
with  the  DoD  is  responsible  to  understand  and  follow 
<'12:17). 


2.  The  PMBOK  a3sum-.c  that  certain  "general  knowledj 
IS  already  possessed  by  the  project  manager.  Becaus 
:i  this  ass'imption,  n'jmeious  traits  of  a  project 
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manager  are  not  included  in  the  PMBOK.  In  the  DoD, 
however,  the  majority  of  J>roject  managers  have  a 
technical,  not  managerial  background.  Because  of  this, 
general  leadership  and  management  disciplines  cannot  be 
assumed  but  must  be  taught  and  then  tested  in  a 
certification  program  (21:2*3) .  Conversely,  the 
competent  DoD  program  manager  is  skilled  in  other 
fields  that  are  emphasized  in  the  DoD,  such  as  systems 
engineering,  logistics,  and  test  and  evaluation.  These 
activities  receive  only  cursory  attention  by  the  PMBOK. 

3.  The  PMBOK  assumes  a  different  project  life  cycle 
than  that  assumed  by  the  DoD,  The  PMBOK  assumes  that 
the  project  life  cycle  ends  with  the  termination  of  the 
activity  needed  to  develop  a  facility  or  product. 

Within  the  DoD,  however,  the  program  manager  retains 
responsibility  over,  the  system  through  its  disposal  as 
illustrated  in  Figure  8.  Thus,  the  DoD  project  manager 
must  .be  familiar  with  cost  and  logistic  considera*- ions 
that  may  span  a  decade  or  more  (21:1*3), 
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FIGURE  8:  Comparison  of  the  Life  Cycles  of  Corporate 

Projects  and  DoD  .Acquisition  Programs.  (21: 1*3) 


27 


4.  The  PMBOK  may  have  missed  some  key  areas  which  need 

to  be  addressed  (22:565). 

Because  of  these  knowledge/ requirement  gaps,  the 
categories  listed  in  the  PMBOK  needed  to  be  modified,  and 
additional  categories  added,  before  the  needs  of  the  DoD 
could  be  met.  These  changes  and  additions  were  determined 
■only  after  close  examination  of  various  expert  sources. 

DpD-,^P roject  Management 

Prior  to  World  War  II  the  emphasis  of  defense 
acquisition  was  on  simplicity,  reliability,  and 
producibility .  Defense  acquisition  was  comparable  to  its 
civilian  counterparts,  such  as  the  auto  industry,  which 
stressed  mass-production  (12:9-15).  Weapon  systems  such  as 
"...aircraft,  ships  and  tanks,  were  developed  and  produced 
as  part  of  the  normal  ongoing  function  of  factories, 
shipyards  and  arsenals"  (2:3).  Towards  the  end  of  the 
1950's  emphasis  shifted  away  from  long  production  runs 
towards  increased  research,  development,  evaluation,  and 
testing.  After  the  1950s  the  DoD  wanted  systems  that 
incorporated  the  most  advanced  technological  innovations. 
Military  budgets  were  high  and  resources  were  available. 
(12:9-15) 

The  1930 's  and  1990 's  found  a  different  scenario.  The 
increasing  and  constantly  changing  weapon  technologies  had 
outpaced  the  budgets  necessary  to  sustain  their  development. 
Since  the  1950 's  DoD  acquisitions  have  switched  from  mass - 
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production  items  to  complex,  unique  weapon  systems.  This 
trend  is  especially  visible  in  the  complexity  of  modern 
missiles,  aircraft,  and  ships.  Such  weapon  systems, 
"...include  not  only  the  major  item  of  equipment  itself,  but 
the  subsystems,  logistical  support,  software,  construction 
-and  training- needed  to  operate  and  support  it"  (12:9).  By 
1986,  there  were  almost  100  major  weapon  systems  at  various 
stages  of  completion.  These  systems  included,  "...thousands 
of  jet  fighters,  bombers  and  transport  aircraft;  one  hundred 
new  combat  and  support  vessels;  and  thousands  of  tanks  and 
cannon-carrying  troop  transports  and  strategic  and  tactical 
missiles"  (12:9).  Such  systems  were  designed  to  achieve 
goals  and  performance  levels  never  before  realised  and  to 
use  technology  new  to  military  acquisition.  To  accomplish 
this,  DoD  emploj-^  thousands  of  prime  contractors  and 
hundreds  of  thousands  of  subcontractors  and  suppliers  (12:9- 
15).  Thus,  the  switch  to  project  management  in  DoD 
acquisitions  came  about  for  a  variety  of  reasons  including; 

•  The  existence  of  stringent  time,  cost  and 
performance  requirements 

•  DoD  undertakings  are  of  greater  complexity  and  scope 
than  normally  found  in  the  business  environment 

•  Significant  contr ibutions  were  required  by  two  or 
more  functional  areas 

•  The  rewards  for  success,  or  penalties  foi  fiiluri-, 
were  especially  high.  (2:4) 

Another  important  factor  which  needs  to  be  considered 
was  the  risk  encountered  by  the  DoD  in  maior  weapon  system 
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-acquisition.  As  technology  increases,  the  risk  to  both 
buyer  and  seller  alike  increases  and  thus  the  management  and 
technological  development  of  a  project  becomes  much  more 
comple.x.  A  major  weapon  system  involves  the  expenditure  of 
large  sums  of  public  funds  and  often  projects  span  numerous 
years  during  which  literally  thousands  of  components  must  be 
delivered  and  integrated  into  a  workable  unit.  Due  to  the 
dependence  on  the  public  for  funding,  and  the  time  span 
involved  for  the  project  to  reach  completion,  the  project 
manager  is  faced  with  a  situation  which  can  (and  often  does) 
change  at  any  moment,  drastically  effecting  the  resources 
available  for  project  completion  (2:26-28).  The  external 
environment,  as  well  as  the  contractors  associated  with  the 
project,  must  be  constantly  monitored  and  guided  by  the  DoD 
project  manager  throughout  the  lifecycle  of  the  project  in' 
order  to  effectively  meet,  and  respond  to,  this  change  and 
ensure  that  a  quality  product  is  developed  and  delivered. 
(12:9-15)  Project  management  offers  the  flexibility  to 
successfully  deal  with  these  changes  in  a  time  efficient' 
manner . 

Training  and  Educating  DoD  Managers.  Although  .rioc 
neophyte  DoD  project  managers  are  'rained  wit’n  lespe';'  ro 
the  technology  of  their  project,  they  tend  to  lack  a  basic 
understanding  of  the  managerial  functions  which  aie  required 
in  order  to  pertorm  their  ^obs  effectively.  3^'^cause  of  :h:s 
"k.oo’w  1  e<.ige  gat"  th-  full  benefits  offered  by  using  orogec*" 
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management  as  a  means  of  system  acquisition  are  not  being 
realized  and  the  problems  noticed  in  past  defense 
acquisitions  are  being  repeated  in  the  present,  (2:60) 


In  an  attempt  to  correct  these  problems,  the  DoD  has 


two  primary  institutions  for  defining  and  teaching  project 
management.  These  institutions  are  the  Defense  Systems 
Management  College  (DSMC)  near  Washington  D.C.,  and  the  Air 
Force  Institute  of  Technology,  near  Dayton,  Ohio. 

The  Defense  Systems  Management  College.  The 

Defense  Systems  Management  College  (DSMC)  was  established  in 

1971  under  the  direction  of  Deputy  Secretary  of  Defense 

David  Packard  (5:5)..  The  purpose  of  the  DSMC  is  to: 

...create  an  atmosphere  of  quality  which  fosters 
personal  growth,  professional  development  and 
empowerment  of  its  people  and  its  customers;  by  the 
21st  century  it  will  be  the  Department  of  Defense  focus 
of  e:<cellence  in  acquisition  education,  research,  and 
information  dissemination.  It  will  enhance  public 
confidence  by  leading  continuous  improvements  in  the 
acquisition  management  process  throughout  congress,  the 
Department  of  Defense,  and  the  defense  industry. 

Through  high  quality  of  service  to  the  entire  range  of 
customers,  DSMC  graduates  will  be  recognized  by 
lawmakers,  policy  makers  and  decision  makers  as  the 
preeminent  academy  of  acquisition  managemanz .  ( : : ” ' 

Every  prospective  DoD  Program  Director  is  required  to 


'iZ“en''  a  20-week  Program  .Management 
caking  command  of  a  iT;a;;or  piogram. 
Acquisition  (Category  I)  Program  in 
•Million  in  research  and  development 
total  pr ■-cur emen*  -'.rt  ''fiscal  year 


Ci.-urc*-  ac  DSMC  b'--fore 


A  Major  Def-nse 
the  DoD  exceeds  $300 
cost  or  $1.3  Billion  in 
I'^OO  dol  Inis).  (  } ;  3  ) 
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There  are  nine  basic  areas  of  study  that  are  covered 
during  the  student's  20  week  stay  at  DSMC.  These  include: 


1.  Acquisition  Management 

2.  Financial  Management 

3.  Procurement  Planning  and  Contract  Management 

4.  Engineering  Management 

5.  Logistics  Management 

6.  Test  and  Evaluation 

7.  Production  Management 

8.  International  Activities,  Joint  Programs  and 

Foreign  Material  Sales 

9.  Other  (6:v-vii) 

The  Air  Force  Institute  of  Technology.  The  Air 
Force  institute  of  Technology  was  established  in  1947  and 
offers  numerous  short  courses  in  the  field  of  acquisition 
program  management .such  as  Acquisition  Planning  and 
Analysis,  Test  and  Evaluation  Management,  Contract 
Management,  and  Lo3i,stics  Management.  It  also  has  an 
accredited  .Master  of  Science  deg,ree  program  in  Systems/ 
Project  Management  that  is  offered  on  a  competitive  ba-sis  to 
military  officers  and  DoD  civilian  employees. 

The  goal  of  both  these  DoD  institutions  is  to  ensure 
that,,  "...members  of  our  military  services  and  associated 
civil  servants  in  the  defense  acquisition  bu.oiness  have  the 


n  e  cess 


j  e  s  s  a .  y 


e:<pertise  to  manage  defense  systems  effecti'; 


Continuing  Problems  in  DoD  Acqui.citioii.  Even  with  ’■he 
education  offered  by  DSMC  and  AFIT,  problems  continue  to  be 
’■'.oted  in  d’-‘'ense  proje-'t  management  workforce.  Such 


about  3i%  in  approximately  half  of  BoD  acquisition  programs 
Kbso,  more  than  nine  in  ten  programs  have  exceeded  initial 
cost  estimates  and  the  average  cost  increase  for  the 
majority  has  been  more  than  50%,  excluding  the  effects  of 
quantity  changes  and  inflation.  (12:33) 

Such  problems,  "...caused  many  Americans  to  question 
•DoD's  management  capability  as  well  as  the  integrity  of  the 
defense  industry"  (12:31).  In  order  to  reverse  such  trends 
and  alleviate  public  doubt,  project  managers  must  become 
more  effective  and  efficient  in  the  performance  of  their 
jobs . 

Q.o.nc.lusion 

The  public  attention  that  is  focused  on  DoD  project 
managers,  together  with  the  responsibility  and  control  thcs 
managers  have  over  appropriated  public  funds,  are  enough  to 
underscore  the  importance  of  a  highly  trained  and  competent' 
corps  of  project  managers  at  all  levels  of  Ji.o  acquisition, 
management  activities.  The  education  and  training  of  DoC 
project  managers  mr.st  becom.e  standardised,  comprehensive, 
an:l  verifiable.  This  can  be  accom.p  1  i shed  by  establishing  a 
de  f --n.v  'p-'.':  f  i  .■  p;- ,ti  u'.agem.er.  ■:  f  -'Ij  ■  -.•hi 

''an  be  further  usel  to  develop  edu'^a",  ion  .and  tiaining 
programs,  and  to  certify  potential  DoD  program  aana-j-is 
have  mastered  the  b?;ly  of  knowledge. 
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III.  Methodology 


Introduction 

This  section  discusses  the  development  of  a  model  DoD 
Project  Management  Body  of  Knowledge,  and  describes  the 
process  by  which  this  model  was  finalized  and  validated. 

Methods  of  Approach 

Two  research  methods  were  used  to  accomplish  this 
thesis:  History  and  Survey.  The  history  method  involved  a 
comprehensive  literature  review  which  gathered  information 
from  four  areas: 

1.  The  Project  Management  Institute's  Project 
Management  Body  of  Knowledge  (PMBOK) 

2.  DoD  project  management  institutions 

3.  Project  management  literature 

4.  DoD  subject  matter  experts 

The  section  "Development  of  a  Hypothetical  Model"  describes 
how  these  sources  were  used  to  develop  a  draft  version  of 
the  DBOK. 

The  survey  method  involved  a  mail  survey  distributed  to 
every  program  director  and  deputy  program  director  of  a 
Major  Defense  .Acquisition  (Category  T)  program.  The  lesulrr 
of  this  survey  were  used  to  validate  the  draft  DBOK.  The 
section  "Validation  of  the  Hypothetical  Model"  discusses  the 
survey,  the  survey  instrument,  and  the  treatment  of  the 
resulting  data. 
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Development  of  tfie  Hypothetical  Model,  The 
hypothetical  model  of  the  DBOK  was  built  in  a  top-down 
manner,  beginning  with  the  structure  of  the  model,  followed 
by  selection  of  major  subject  areas,  and  concluding  with 
selection  of  sunareas  within  each  major  subject  area.  Each 
phase  of  the  development  process  of  the  hypothetical  model 
is  discussed  below. 

Structure.  The  .structure  of  the  hypothetical 
model  was  patterned  after  the  PMI's  PMdOK.  The  PMBOK  is 
organiz.ed  as  a  lisc  of  eight  major  subject  areas,  all  of 
which  are  further  broken  down  into  subareas  by  using  a  work 
breakdown  structure.  The  DBOK  was.  initiated  in  the  same 
manner.  Major  areas,  the  foci  of  the  DBOK,  were  determined 
and  then  were  further  brolten  down  into  subareas. 

Content;  Major  Subject  Areas,  The  major  areas  of 
the  model  DBOK  were  derived  from  three  sources.  The  first 
source  was  the  PMBOK.  Experts  from  PMI  did  much  preliminary 
work  on  the  development  of  the  PMBOK  during  the  early 
1980's,-  In  order  to  avoid  duplication  the  PMBOK  wa.s  used  as 
the  starting  point  for  the  content  of  the  DBOK.  The  major 
subject  areas  of  the  PMBOK  are: 
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;  ,  •  Scope  Management  •  Contract/Procurement 

.  *  , Quality  Management  Management 

•  Time  Management  •  Communications 

•  Cost  Management  Management 

‘  •  Risk  Management  (21:3»5) 

'  .  •  Human  Resources 

■  '  ^  Management 

The  Second  source  was  DoD  project  management 
educational  institutions.  The  two  institutions  examined 
w.ere  DSMC  and  APIT.  It  was  essential  to  research  these 
institutions  because  their  curricula  represent  the  best 
present  model  of  the  specific  skills  and  knqwledge  required 
to  be  a  competent  project  manager  in  the  DoD  environment. 
Both  curricula  were  examined  and  it  was  seen  that,  as 
e.xpected,  they  heavily  overlapped  one  another.  Since  the 
DSMC  Program  Management  Course  (PMC)  curriculum  had  already 
been  compiled  into  an  easily  readable  and  usable  format, 

DSMC  became  the  primary  educational  source  while  the  DBOK 
was  being  developed.  AFIT  course  documents  were  used  as  a 
secondary  source. 

The  third  source  was  the  literature  in  the  project 
management  field  that  was  discussed  throughout  Chapter  II  of 
this  document.  This  literature  was  reviewed  to  identify  the 
subject  areas  that  experts  in  the  field  of  project 
management  considered  *o  be  important.  It  was  necessary  to 
cover  a  significant  amount  of  literature  due  to  the 
possibility  that  both  PMI  and  DoD  project  management 
institutions  may  have  missed  important  topics.  The 
bibliography  li.ots  the  texts  and  materials  consul  t>'d. 
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after  examination  of  the  three  sources,  a  total  of  13 
major  subject  areas  were  identified  and  input  to  the  model 
DBOK  structure.  Figure  9  shows  how  the  major  subject  areas 
in  the  PMBOK  and  the  DSMC  PMC  curriculum  correlate  to  those 
in  the  model  DBOK. 

Content;  Subareas.  After  the  13.  major  subject 
areas  were  determined,  subareas  were  added  to  each  area 
using  the  same  source  references  discussed  in  the  previous 
section.  Initially  many  candidate  subareas  were  identified 
under  each  major  area.  These  subareas  were  carefully  edited 
and  combined  to  make  each  area  as  parsimonious  as  possible 
while  remaining  exhaustive  of  knowledge  requirements.  The 
product  of  this  process  was  the  first  complete  draft  of  the 
DBOK. 

The  draft  DBOK  was  presented  to  e.xperts  for  comments. 
The  experts  used’ were  the  AFIT  faculty  and  The  Department  o 
Educational  Research  at  DSMC.  Each  instructor  ot  AFIT  v.id 
DSMC  specializes  in  a  specific  aspect  of  project  management 
and  has  a  basis  for  understand.lng  the  unique  knowledge 
requirements  of  DoD  project  managers.  The  ma:jor  subject 
areas  were  extracted  individually  with  their  assoc  i  n  ■  ^-d 
subareas  and  were  distributed  to  the  respective  .3ub]ect 
experts  for  comment.  In  all  cases,  additions  and  deletions 
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FIGURE  9:  Development  of  DBOK  Majoi'  Areas  from  the  PMBOK 
and  the  DSMC  PMC  Curriculum. 


were  made  to  the  model  DBOK  to  reflect  the  inputs  made  by 
the  instructors.  The  result  was  a  revised  model  DBOK, 
consisting  of  the  13  major  subject  areas  and  associated 
subtopic  areas  ranging  in  number  from  7  to  13. 

Validation  of  the  Hypothetical  Model 

The  hypothetical  model  DBOK  was  validated  with  a  survey 
administered  by  PMI  to  all  directors  and  deputy  directors  of 
Major  Defense  Acquisition  (Category  I)  programs. 

Survey.  The  purpose  of  the  survey  was  to  solicit 
feedback  from  practicing  experts  in  the  field  of  DoD 
acquisition  program  management.  The  population  of  program 
directors  and  deputy  directors  of  major  DpD  acquisition 
programs  is  a  population  of  experts,  and  as  such,  is  the 
best  community  to  review  and  validate'  the  hypothetical  model 
DBOK . 

Survey  Background.  The  survey  was  used  to  measure 
the  importance  of  each  major  subject  area  and  each  subarea 
in  the  model  DBOK.  The  survey  was  necessary  to  either 
validate  the  model  DBOK  as  being  complete  (e.g., 
collectively  exhaustive  of  the  knowledge  necessaiy  to  be  a 
competent  Defense  Project  Manager)  or  to  complete  the  DBOK. 
Two  governing  assumptions  were  applied  at.  the  beginniiig  ot 
the  survey  process. 
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1.  The  model  was  basically  sound,  and  no  "bad”  areas 
or  subareas  would  withstand  scrutiny  of  the  AFIT 
faculty  and  DSMC.  Therefore  few,  if  any,  major  areas 
or  subareas  would  need  to  be  deleted  as  a  result  of  the 
survey. 

2.  Any  weakness  of  the  hypothetical  model  would  be 
that  important  subject  areas  or  associated  subareas  had 
been  omitted. 

With  respect  to  these  assumptions  the  survey  was 
designed  to  solicit  feedback  from  each  respondent  as  to  what 
should  be  added  to  the  body  of  knowledge.  Conversely,  the 
opportunity  for  deletion  was  also  present  in  the  form  of  a 
"Comment"  section  in  the  survey  instrument. 

Survey  Instrument  Design.  Much  of  the  survey  design 
was  based  on  DHlman's  Mail  and  Telephone  Surveys:  the  Total 
Design  Method . 

The  DECK  questionnaire  contained  five  sections: 

1.  A  ranking  of  the  13  major  subject  areas 

2.  A  rough  prioritization  of  the  subareas  associated 
with  each  major  area 

3.  An  identification  of  additional  training 
requi rements 

4.  Demographic  information 

5.  Glossary. 

The  survey  instrument  with  the  model  DBOK  can  be  seen  at 
Appendix  B. 

Part  I:  Area  Ranking.  The  objective  of  the  first 
section  of  the  survey  was  to  prioritize  the  major  areas. 

The  questionnaire  listed  only  the  major  subject  area  titles 
in  the  model  DBOK.  Each  was  briefly  defined.  The 
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respondent  was  asked  to  rank  the  areas,  1  through  13,  in 
terms  of  their  relative  importance  to  the  working- 1 evel 
project  manager.  Two  additional  choices  labeled  "OTHER" 
were  opportunities  for  the  respondent  to  identify  additional 
major  subject  areas  which  should  be  added  to  the  DBOK. 

Part  II;  Subarea  Prioritization.  The  objective  of 
the  second  section  was  to  prioritize  the  subareas  within 
each  area.  The  entire  model  DBOK,  major  subject  areas  and 
associated  subareas,  was  displayed.  The  respondent  was 
asked  to  mark  a  "T"  ("top  importance")  next  to  the  three 
most  important  subareas  under  each  major  subject,  and  a  "B" 
("bottom  importance")  next  to  the  three  least  important 
subareas.  This  method  minimized  the  time  required  to 
complete  the  section,  thus  averting  respondent  frustration 
and  the  negative  effects  such  frustration  would  have  had  on 
the  response  rate.  Restricting  all  respondents  to  six 
entries  per  area  (three  T  and  three  B)  normalized  the  input 
per  respondent  per  area,  and  controlled  the  central  tendency 
of  all  subarea  scores  to  1.0.  This  was  significant  because 
it  prevented  respondents  from  corrupting  the  response  data 
by  marking  all  subareas  as  of  top  or  bottom  importance  in  a 
favored  or  1 eas t - favor i te  area.  As  in  the  first  section, 
blank  spaces  were  included  for  the  respondent  to  enter 
additional  subareas  that  were  required. 

Part  III;  Training  Needs.  The  third  section  of 
the  survey  assessed  training  needs.  the  respondent  was 
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again  presented  with  the  entire  model  DBOK  and  was  asked  to 
circle  any  subarea(s)  where  there  was  an  acute  training 
need.  Also,  the  respondent  was  asked  to  specify  the  most 
effective  method  to  impart  such  training  (e.g.,  on-the-job 
training,  short  courses,  etc). 

Part  IV:  Demographics.  The  fourth  section  was  a 
series  of  demographic  questions  regarding  the  respondent's 
service  affiliation,  position,  experience,  education,  and 
job  satisfaction. 

Part  V;  Glossary.  The  fifth  and  last  section 
consisted  of  a  glossary  which  briefly  defined  each  subarea 
mentioned  in  the  model  DBOK.  The  glossary  served  two 
purposes;  1)  to  prevent  any  biases  in  the  response  data  due 
to  differences  between  service  vocabularies,  and  2)  to 
minimize  noise  in  the  data  due  to  individual  interpretations 
of  subarea  titles. 

Survey  Pre-Test.  The  draft  survey  was  pre-tested 
on  a  sample  of  25  AFIT  graduate  students  in  the  Systems/ 
Project  Management  degree  program.  Most  of  these  students 
have  had  prior  experience  in  the  acquisition  arena  as  DoD 
project  managers.  The  comments  about  the  survey  design  wer” 
superficial  and  varied.  No  two  comments  addressed  the  same 
issue.  The  conclusion  from  the  pre-test  was  that  the  survey 
was  understandable  and  structurally  sound.  No  changes  to 
the  questionnaire  resulted  from  the  pre-test.  (11:206-207) 


Survey  Distribution.  The  survey  was  distributed  by  PMI 
to  all  directors  and  deputy  directors  of  Major  Defense 
Acquisition  (Category  I)  programs.  Appro.ximately  three 
weeks  were  allowed  for  response.  The  Department  of 
Educational  Research  at  DSMC,  co-sponsor  of  the  survey  with 
PMI,  received  the  completed  questionnaires.  At  the  three 
week  point  the  surveys  that  had  been  returned  were  analysed. 

Analysis 

This  section  discusses  the  reduction- of  the  body  of 
survey  response  data  and  the  decision  rules  governing  the 
survey  results.  The  response  data  were  input  manually  into 
a  337  X  N  array,  where  N  represents  the  number  of  responses. 
The  data  were  reduced  using  Quattro  Pro  (v.2.0)  spreadsheet 
software.'  Quattro  Pro  was  also  used  to  develop  the  ‘graphic 
displays  shown  later  in  this  document.  The  methodologies 
governing  data  reduction  are  described  below. 

Part  1;  Major  Area  Ranking.  The  set  of  responses  for 
each  major  area  in  Part  1  was  simply  averaged  to  determine 
the  final  prioritization  of  major  areas.  The  average 
"score"  for  each  major  area  represents  its  relative 
importance  on  a  I  to  13  scale  (1  most  important).  M.->:or 
areas  that  were  added  by  respondents  were  treated  aooo.’.ding 
to  the  following  rule; 

Decision  Rule  -  Treatmmt  of  Major  Areas  Added  by  Respondents:  If 
a  major  area  was  added  and  ranked  by  respondents  such  that  its 
score  was  greater  than  the  score  achieved  by  the  lowest  of  the 
original  thirteen,  then  it  was  added  to  the  BOK;  else,  no  major 
area  was  added. 
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Part  2:  Subarea  Ranking.  The  survey  responses  for  each 

subarea  in  Part  2  were  treated  as  follows:  score  of  0  for 

each  subarea  awarded  a  "B,"  score  of  1  for  each  subarea 

awarded  neither  "B"  nor  "T,”  and  score  of  2  for  each  subarea 

awarded  a  "T."  The  mean  score  was  calculated  for  each 

subarea.  The  mean  score  represents  the  importance  of  that 

subarea,  relative  to  the  others  in  the  area,  on  a  0  to  2 

point  scale  (2  most  important).  Subareas  that  were  added  by 

respondents  were  treated  according  to  the  f ol 1 owing^ rul e : 

Decision  Rule  -  Treatment  of  Subareas  Added  by  Respondents:  If  a 
subarea  was  added  and  ranlced  by  respondents  such  that  its  final 
score  was  greater  than  that  achieved  by  the  lowest  scoring  subarea 
in  the  major  area,  then  it  was  added  to  the  BOK;  else,  no  siabarea 
was  added. 

Part  3:  Training  Needs.  The  training  needs  of  DoD 
project  managers  were  assessed  as  follows.  For  each 
response,  a  score  of  zero  was  assigned  each  subarea  not 
indicated  as  a  training  need  area.  A  positive  score  was 
assigned  each  subarea  identified  as  a  training  need  area; 
that  score  was  equal  to  the  number  selected  as  the  ideal 
type  of  training  ( e .  g .  score  of  3  if  Short  Course  was 
identified).  The  Frequency  function  in  Quattro  Pro  was  used 
to  determine  the  ili s i. r i but  i  on  of  entri-^s  fo:  e.io’h  subar-^?:. 

Th j  result  was,  for  each  subarea,  the  number  of  respondents 
that  identified  that  subarea  as  a  training  ntsed,  and  the 
best  training  method  indicated. 


IV. 


Findings 


Introduction 

This  section  presents  the  results  of  the  survey  and  th 
final,  validated  Defense  body  of  knowledge. 

Survey  Results:  Response  and  General  Feedback 

Out  of  148  questionnaire  packages  mailed,  53  were 
returned  for  a  total  response  rate  of  36%.  All 
questionnaires  that,  were  returned  contain  useable  data  cn 
which  the  remainder  of  this  chapter  is  based. 

General  feedback  added  by  respondents  to  the  comment 
page  at  the  end  of  the  survey  is  summarized  at  Appendix  C. 

Survey  Results:  Body  of  Knowledge 

Part  I:  Major  Areas,  The  reduced  data  £;*om  the  major 
area  ranking  are  listed  in  Table- 1.  Two  columns  show  th? 
mean  rank  (X)  and  standard  deviation  (o)  for  each  major  are 
listed  in  the  left  column.  In  Table  I  the  lower  rank 
represents  the  higher  priority.  The  results  are  displayed, 
graphically  in  Figure  10.  The  horizontal  bar  char^  di.:play 
the  relative  importance  of  each  major  ar<'a  with  *■!.>-.■  most 
im.portant  (lowest  score,  sh.srt  bars]  th-  l-t*  --I 
chart.  To  ]  lie  light  of  each  bar  is  the  mean  numeric  lank;: 
of  that  area. 
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TABLE  1: 


MAJOR  AREA  PRIORITY 
(LOW  Xbar  =  HIGH  PRIORITY) 


j  MAJOR  AREA: 

Priority 

(X) 

— ---  - . — ,1 

1 

Standard 
Deviation  ! 
(o)  1 

1 

1  STRATEGY  AND  PLANNING 

3.74 

2.71  1 

] 

j  QUALITY  MANAGEMENT 

7.72 

3.34  ; 

COST  MANAGEMENT 

5.00 

2.65 

RISK  MANAGEMENT 

5.53 

3.02 

LEADERSHIP/ PERSONAL  SKILLS 

2.89 

2.94  ;| 

1  MANAGEMENT  TECHNIQUES 

5.89 

:! 

3.29  ! 

SYSTEMS  ENGINEERING 

6.81 

2.79  ;i 

TEST  AND  EVALUATION  MANAGEMENT 

9.03 

1 

LOGISTICS  MANAGEMENT  ' 

9.36 

1 

2.13 

MANUFACTURING  MANAGEMENT 

10.85 

2.42  j 

CONTRACT  MANAGEMENT 

6.92 

j 

2.57  ! 

1 

SOFTWARE  MANAGEMENT 

10.13 

2.87  ' 

AEROSPACE  AND  DEFENSE  MANAGEMENT 

5.62 

3.96  " 

1) 
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FIGURE  10:  Survey  Results:  Major  Area  Ranking.  (N=53) 


Part  II:  Subareas.  The  ranking  of  the  subareas  within 
each  major  area  are  presented  below. 

Strategy  S  Planning.  Table  2  displays  the  results 
of  the  Strategy  &  Planning  subarea  ranking  in  terms  of  mean 
importance  and  standard  deviation.  Unlike  the  data  in  Table 
1  above.  Table  2  and  those  that  follow  show  the  more 
important  subareas  with  higher  scores.  Figure  11  shows  the 
results  graphically.  As  is  the  case  with  the  tabular  data, 
the  scale  on  the  horizontal  axis  in  Figure  11  is  reversed 
from  that  of  the  Major  Area  display;  the  left  of  the  chart 
represents  the  lowest  priority,  the  right  of  the  chart 
(highest  score,  long  bars)  represents  the  highest  priority. 


TABLE  2: 

RESULTS  OF  STRATEGY  &  PLANNING  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


. . . .  ..  II  , 

Subarea : 

Importance 

(X) 

- w 

standard  'j 
Deviation  i 

(o)  ' 

Work  Breakdown  Structure 

0.75 

o 

00 

Statement  o£  wolR 

1  . 19 

0.79 

Network  Analysis 

0 .40 

o 

-0 

Project  Life-Cycle  Analysis 

0 . 92 

0.81  ; 

Forecas  ting 

0.74 

0.86 

Management  Information  System.s 

0.83  . 

0.78  j 

Acquisition  Strategy/Planning 

1 

0.47  ; 

1 

1  Acquisition  Process 

1 

1  .  47 

o 

oo 

o 
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FIGURE  11:  Importance  of  Strategy  &  Planning  Subareas. 
(N=53) 


Quality  Management.  Table  3  shows  the  results  of 
the  prioritization  of  the  subareas  within  the  Quality 
Management  area.  Figure  12  displays  the  data  graphically. 


TABLE  3: 

RESULTS  OF  QUALITY  MANAGEMENT  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Subarea : 

Importance 

(X) 

Standard 

Deviation 

(0)  j 

Quality  Assurance 

1.04 

0.90  1 

Total  Quality  Management 

1.74 

0.62 

Quality  Controls/Standards 

0.81 

0.79 

Quality  Costs 

0.55 

0.72  ; 

Quality  Theory 

0,38 

0.71  ! 

Quality  Evaluation  Methods 

0 . 96 

0.88 

User/Customer  Relations 

1.62 

0.69  ; 
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Cost  Management.  Table  4  illustrates  the 
prioritization  of  the  subareas  within  the  Cost  Management 
area.  Figure  13  displays  the  data  graphically. 


TABLE  4: 


RESULTS  OF  COST  MANAGEMENT 
(HIGH  Xbar  =  HIGH  IM 


PRIORITIZATION 

PORTANCE) 


Subarea : 


Importance 

(X) 


Standard 

Deviation 

(o) 


Estimating 


1.23 


0.70 


Life  Cycle  Cost  Analysis 


1.19 


0.65 


Design  to  Cost 


0 . 66 


0.71 


Planning,  Programming  &  Budgeting 
System 


1 . 68 


0 . 61 


Reprogramming 


0.91 


0 . 66 


Cost/Schedule  Control 


1.64 


0.52 


Contractor  Financial  Management 


1 . 26 


0 . 62 


Financial  Analysis  of  DoD 
Contractors 


0 . 62 


0 . 60 


Project  Accounting 


0 . 70 


0 . 64 


Capital  Investment 


0.36 


0 . 48 


Should  Cost/Could  Cost  Analysis 


0 . 81 


0 . 59 
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COST  MANAQSMENT 


Uft  Cyeit  Cott  Analytii 


DMlgntoCoat 


Planning,  Programming  &  Budgating  Syatam 


Raprogramming 


Coat/Schaduia  Control 


Contractor  Financial  Managamant 


Project  Accounting 


Dob  Contraaora 


Should  Coat  /  Could  Coat  /(naiya 


0.25  0.5 

BOTTOM  IMPORTANCE 


MEAN  SURVEY  RESPONSE 


1.5  1.75  2 

TOP  IMPORTANCE 
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Risk  Management.  Table  5  provides  the  results  of 
the  prioritization  of  Risk  Management  subareas.  Figure  14 
shows  the  results  graphically. 


TABLE  5: 

RESULTS  OF  RISK  MANAGEMENT  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Importance 

Standard 

Subarea : 

Deviation 

(X) 

(o) 

Risk  Planning 

1.26 

0.86 

Risk  Assessment 

.1.70 

mgmm 

Sources  of  Risk 

0.85 

0.79 

Risk  Identification 

BOB 

■em 

Risk  Analysis 

1.17 

0 . 67 

Risk  Avoidance 

0.75 

0.76 

Unavoidable  Risk 

0.13 

0.39 

Value  Analysis 

0.47 

0.72  J 
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FIGURE  14:  Importance  of  the  Risk  Management  Subareas. 


(N=53) 
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Leadership/ Personal  Skills.  The  results  of  the 


Leadership/Personal  Skills  subarea  prioritization  are  listed 
in  Table  6.  The  prioritized  subareas  are  displayed  in 
Figure  15. 


TABLE  6: 


RESULTS  OF  LEADERSHIP/ PERSONAL  SKILLS  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Subarea : 

Importance 

(X) 

Standard 

Deviation 

(o)  1 

Personal  Ownership  &  Commitment 

1.45 

0.72 

Motivation  &  Influence 

1.32 

0 . 67 

Political /Organizational 
Awareness/ Power 

0 . 92 

0.85  j 

Relationship  Development  &  Team 
Building 

1.60 

0.69  ! 

Action  Orientation 

■ 

1 

0.67  ' 

Long-Term  Perspective 

0.77 

0.72 

Ethics 

1.51 

0.64  i 

Assertiveness 

0.26 

0.56 
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Management  Techniques.  The  Management  Techniques 
prioritization  results  are  listed  in  Table  7.  The  data  are 
presented  graphically  in  Figure  16. 


TABLE  7: 

RESULTS  OP  MANAGEMENT  TECHNIQUES  PRIORITIZATION 
_ (HIGH  Xbar  =  HIGH  IMPORTANCE) 


Importance 

Standard 

Subarea: 

Deviation 

(X) 

(o) 

Organization  S  Staffing 

1.08 

0.78 

Training,  Developing 

1.06 

0.79 

Counseling  &  Evaluating 

0.87 

0.62 

Communicating 

1.77 

0 . 42 

Time  Management 

1.04 

0.71 

Negotiating 

0.68 

Decision  Making  ■ 

1.64 

0.52  i 

_ JJ 

1  Controlling 

0.40 

Managing  Meetings 

0.51 

■■ 
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Systems  Engineering.  The  results  of  the 
prioritization  of  Systems  Engineering  subareas  are  listed  in 
Table  8.  The  data  are  presented  graphically  in  Figure  17. 

TABLE  8: 

RESULTS  OF  SYSTEMS  ENGINEERING  PRIORITIZATION 


(HIGH  Xbar  =  HIGH  IM 

PORTANCE) 

Subarea: 

Importance 

(X) 

Standard 
Deviation 
(o)  • 

Trade-Off  Analysis 

1.51 

0.72 

Technical  Performance  Measurement 

1.43 

0.72 

Technical  Review  Process 

1.00 

msm 

Producibility  Engineering  S 
Planning 

0.66 

Engineering  Change  Procedures 

0.94 

0.74 

Pre-Planned  Product  Improvement 

0.74 

mam 

j  Configuration  Management 

1.26 

0.52  : 

Specifications  &  Standards 

0.70 

0.72 

1  Integrated  Product  Development 

0.88  ! 
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FIGURE  17:  Importance  of  Systems  Engineering  Subareas.  (N=53) 


Test  and  Evaluation  Management.  The  subareas 
within  Test  and  Evaluation  are  listed  with  their  survey 


results  in  Table  9.  The  data  are  displayed  graphically  in 
Figure  18. 


TABLE  9: 

RESULTS  OF  TEST  AND  EVALUATION  MANAGEMENT  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Subarea : 

Importance 

(X)  . 

Standard 

Deviation 

(o) 

I  Test  S  Evaluation  Master  Plan 

1.66 

1— 1 

o 

DoD  TSE  Process 

0.75 

0 . 92 

DoD  T&E  Policies  and  Directives 

0.66 

0 . 90 

Contractor  TSE  Support 

0.64 

0.88 

Development  TSE 

1.32 

mm 

Operational  TSE 

■  1.32 

0 . 89 
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TEST  &  EVALUATION 


MEAN  SURVEY  RESPONSE 


FIGURE  18:  Importance  of  Test  and  Evaluation  Subareas. 
{N=53) 
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Logistics  Management.  The  Logistics  Management 
subareas  are  listed  with  the  survey  results  in  Table  10. 
The  data  are  displayed  graphically  in  Figure  19. 


TABLE  10: 

RESULTS  OP  LOGISTICS  MANAGEMENT  PRIORITIZATION 
_ (HIGH  Xbar  =  HIGH  IMPORTANCE) _ 


Subarea ; 

Importance 

(X) 

Standard 

Deviation 

(o) 

Contracting  for  Logistics  Support 

0.55 

0.77 

Logistic  Support  Analysis 

1.42 

0.75 

Integrated  Logistic  Support 

1.62 

0.69  * 

Acquisition  Logistics  Management 

1.28 

0.74 

Reliability/ Avail  ability/ 
Maintainabi 1 ity 

1.51 

0.67  j 

Post-Production  Logistic  Support 

0.72 

0.72  1 

Contractor  Support  Planning 

0.51 

0.70 

Logistics  Test  S  Evaluation 

0.57 

0 . 64 
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FIGURE  19:  Prioritized  Logistics  Management  S’bareas. 
(N=53) 
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Manufacturing  Management.  The  Manufacturing 


Management  subareas  are  displayed  with  the  results  of  the 
survey  in  Table  11.  These  data  are  displayed  graphically  in 
Figure  20. 


TABLE  11: 


RESULTS  OF  MANUFACTURING  MANAGEMENT  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Subarea: 

Standard  ! 
Deviation  ! 
(o)  i 

The  Industrial  Review  Analysis 

mam 

0.75 

The  Production  Review  Process 

1.55 

0.75 

Acquisition  Manufacturing  Planning 

1.34 

0.78 

Industrial  Modernization 

Incentives 

0.55 

0.70 

Transition  from  Development  to 

I  Production 

■■ 

■■ 

Manufacturing  Processes 

1.25 

0.83  ! 

Inventory  Management 

0.25 

0.55 
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Contract  Management.  The  subareas  within  the 
Contract  Management  are  listed  with  survey  results  in  Table 
12.  The  data  are  displayed  graphically  in  Figure  21. 


TABLE  12: 


RESULTS  OF  CONTRACT  MANAGEMENT  PRIORITIZATION 
(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Subarea: 


Legal  Aspects  of  Contracting 


Importance 

(X) 


1.11 


Standard 
Deviation 
(o) 


0.64 


Source  Selection 


1.28 


0.72 


Contract  Types 


1.43 


0.72 


Contract  Administration 


1.17 


0.78 


Contract  Modifications 


1.43 


0.60 


Disputes  and  Appeals 


0.81 


0.68 


Subcontractor/Vendor  Management 


0.98 


0.77 


Government  Support  to  Contractors 


0.51 


0.50 


Solicitation  Methods 


0.75 


0 . 65 


Problem  Remedies 


0.91 


0.66 


Warranties 


0.72 


0 . 57 
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FIGURE  21:  Importance  of  Contract  Management  Subareas, 
(N=53) 


Software  Management.  The  results  of  the  Software 
Management  subarea  prioritization  are  listed  in  Table  13, 
and  are  shown  graphically  in  Figure  22. 


TABLE  13: 

RESULTS  OF  SOFTWARE  MANAGEMENT  PRIORITIZATION 
_ (HIGH  Xbar  =  HIGH  IMPORTANCE) _ 


Subarea: 

Importance 

(X) 

Standard 

Deviation 

(o) 

Software  Specifications 

1.00 

0.68 

Languages 

0.17 

0.43 

Mission  Critical  Computer 

Resources 

1.17 

0.70 

DoD  Policies  and  Regulations 

0.96 

0.78 

Software  Metrics 

1.02 

0.80 

Elements  of  Computer  Resources 

0.53 

0.67 

Software  Maintenance 

0.96 

Software  Acquisition 

1.57 

0.60 

Software  Documentation 

1.11 

0.67  1 

Software  Testing 

1.43 

0.60 
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FIGORE  22:  Importance  of  Software  Management  Subareas. 
(N=53) 
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Defense  Program  Management.  The  results  of  the 
prioritization  of  Defense  Program  Management  subareas  are 
listed  in  Table  14  and  are  graphically  displayed  in  Figure 
23. 

TABLE  14: 

RESULTS  OF  DEFENSE  PROGRAM  MANAGEMENT  PRIORITIZATION 


(HIGH  Xbar  =  HIGH  IMPORTANCE) 


Subarea: 

Importance 

(X) 

Standard 

Deviation 

Fedecal/DoD  Acquisition  folioy 

1.72 

0.53 

Federal/DoD  Acquisition 
Organizations 

0.94 

0.72 

■  Tnternational  Project  Management 

0.57 

0.72 

•.Environmental  Policy  and 

1  Regulations 

0.72 

O'.  69 

Management  of  Appropriated  Funds 

1.40 

0.77 

Contractor  Perspectives  on 

Business  Management 

0.72 

0.72 

Joint  Servic.e  Acquisition 

Management 

0.74 

0.71 

Role  of  Congress  in  the 

Acquisition  Process 

1.57 

0.67 

Competition/Al ternate  Sourcing 

1.00 
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Additions  and  Deletions:  No  additions  of  major  areas 
or  subareas  to  the  DBOK  will  result  from  the  survey.  No 
recommendations  for  deletion  were  received.  A  few 
recommendations  for  addition  were  recorded,  but  they  were 
not  sufficient,  according  to  the  decision  rules  discussed 
earlier  in  this  chapter,  to  add  any  major  area  or  subarea  to 
the  DBOK.  The  most  common  recommendations  for  addition, 
however,  involved  the  generation  of  system  requirements. 

One  respondent  recommended  an  rv-lditional  major  area  of 
"Requirements,"  and  another  respondent  recommended  a  subarea 
under  Software  Management  of  "Software  Requirements."  Other 
than  these,  no  two  recommendations  were  similar. 

Part  III;  Training  Needs.  The  results  of  the  training 
need  assessment  are  presented  below.  Table  15  shows  the 
five  subareas  which  accumulated  the  most  indications  as 
acute  training  need  areas.  The  most  common  training  method 
identified  was  "short  course"  for  all  five. 
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TABLE  15: 


TRAINING  NEEDS  OF  THE  RESPONDENTS 


Subarea  (MAJOR  AREA): 

Number  of  j 
Respondents 
Identifying  I 
Training  I 

Need:  | 

Risk  Assessment  (RISK  MANAGEMENT) 

23 

Cost/Schedule  Control  (COST  MANAGEMENT) 

23 

Total  Quality  Management  (QUALITY 
MANAGEMENT) 

22 

Transition  from  Development  to 

Production  (MANUFACTURING  MANAGEMENT) 

22 

Federal/DoD  Acquisition  Policy  (DEFENSE 
PROGRAM  MANAGEMENT) 

•  19 

Part  rV;  Demographics.  The  respondents  are  described 
in  terms  of  service,  education,  and  experience  by  the 
following  graphs.  Figures  24  and  25  show  the  affiliation 
(military  vs  civilian)  and  the  rank/grade  distribution  of 
all  respondents,  respectively.  Figure, 24  also  illustrates 
the  distribution  between  program  directors  and  deputy 
program  directors.  Figure  26  shows  the  representation  of 
each  service  in  the  survey  results. 

The  data  in  Figure  26  are  significant  because  they  show 
that  all  services  are  represented  equally  in  the  survey 
data.  The  low  representation  by  the  Marine  Corps  is 
explained  by  the  lower  number  of  Major  Defense  Acquisition 
programs  managed  by  the  Marine  Corps. 
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FIGURE  25:  Rank/Grade  of  Survey  Respondents.  (N=53) 
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Figures  27  and  28  show  the  amount  of  non-acquisition 
experience  that  the  survey  respondents  bring  into  the 
acquisition  field.  Figure  27  addresses  operational 
experience  (e.g.,  combat  and  combat  support  operations),  and 
Figure  28  addresses  staff  experience  (e.g.,  headquarters/ 
Pentagon  experience). 


77 


OPERATIONAL  EXPERIENCE 


FIGURE  28:  Staff  Experience  of  Respondents.  (N=53) 
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Figures  29  and  30  present  the  amount  of  acquisition-related 
experience  held  by  the  survey  respondents.  Figure  29  shows 
the  amount  of  general  acquisition  experience  (e.g.,  project 
manager,  cost  analyst,  test  manager). 


FIGURE  29:  Acquisition  Management  Experience  of  Respondents. 


(N=53) 


Figure  30  shows  the  amount  of  experience  as  director  of  a 
program  (not  necessarily  a  Major  Defense  Acquisition 
program) . 
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PROQRAM  DIRECTOR  EXPERIENCE 


LfcM  e>io  iimo  MunB 

THAN  THAN 

1YEAR  15  YEARS 


FIGURE  30;  Experience  as  Director  of  a  Defense  Acquisition 
Program.  (N=53) 

Figure  31  shows  the  education  of  the  survey  respondents 
in  terms  of  degrees  earned  and  fields  of  education.  Some 
respondents  to  this  block  of  questions  in  the  survey 
identified  their  highest  degree  earned  without  identifying 
preceeding  degrees.  This  was  evident  when  a  respondent 
would  indicate  that  he  held  a  Master's  degree  but  no 
Bachelor's  degree,  and  is  supported  by  the  observation  that 
the  total  Bachelor  degrees  indicated  by  Figure  31  do  not  sum 
to  at  least  53  (the  number  of  respondents).  The  data  in 
Figure  31,  therefore,  underestimate  the  number  of 
Baccalaureate  degrees  earned  by  the  respondents. 
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MATH/SCIENCE 


BUSINESS/ 

MANAGEMENT 


FIGURE  31:  Education  of  Survey  Respondents.  (N=53) 


Finally,  Figure  32  shows  the  job  satisfaction  among  the 
survey  respondents;  that  level  of  satisfaction  is  obviously 
high.  One  respondent,  however,  scored  himself  off  the  scale 
past  "extremely  dissatisfied,"  indicating  that  he  was  highly 
chal lenged’personal ly  but  "professionally  frustrated  with 
the  process." 


Job  Satisfaction  of  Survey  Respondents.  (N=53) 


V.  Conclusions  and  Recommendations 


Introduction 

This  section  closes  the  research  project  by  discussing 
the  results  of  the  research  and  what  they  mean  to  the 
Project  Management  Profession  in  general ,  and  Defense 
Program  Management  in  particular. 

Validated  Body  of  Knowledge 

The  model.  DBOK  was  validated  by  the  population  of 
Directors  and  Deputy  Directors  of  Major  Defense  Acquisition 
Programs.  This  means  that  the  DBOK  produced  by  this 
research  project  defines  the  knowledge  necessary  for  a  DoD 
program  manager  to  be  effective. 

Accreditation  and  Certification.  As  a  validated, 
exhaustive  definition  and  baseline  of  the  knowledge  required 
of  a  DoD  program  manager,  the  DBOK  presented  here  is  an 
adequate  foundation  for  the  structure  of  the  DoD  Program 
Management  Profession.  That  structure  would,  by  the 
definition  of  a  profession  given  in  Chapter  II  of  this 
document,  involve  accreditation  of  educational  institutions 
and  certification  of  individual  managers  across  the  DoD. 
Furthermore,  the  DBOK  is  an  adequate  guide  to  the  continuing 
professional  development  of  certified  DoD  program  managers, 
and  would  be  useful  as  a  basis  for  recertifying  program 
managers . 
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Deficiency:  Schedule  Control.  Based  on  preliminary 
review  of  this  study  and  the  DBOK  by  PMI  leadership  and 
DSMC,  the  first  area  of  change  for  the  DBOK  should  be  in  the 
area  of  Schedule  Control.  The  DBOK  as  it  appears  in 
Appendix  A  addresses  Schedule  Control  only  indirectly 
through  the  Cost/Schedule  Control  and  Time  Management 
subareas  (under  COST  MANAGEMENT  and  MANAGEMENT  TECHNIQUES 
areas,  respectively).  More  attention  is  required,  however, 
in  order  for  the  DBOK  to  clearly  identify  Schedule  Control 
as  an  important  element  of  the  knowledge  that  any  effective 
manager  brings  to  bear  on  a  project.  The  importance  of 
scheduling  knowledge  to  a  DoD  program  manager  is  obvious 
when  one  considers  the  complexity  of  modern  weapon  systems 
and  the  history  of  poor  schedule  performance  for  many  DoD 
acquisition  programs.  Furthermore,  the  justification  for 
adding  an  explicit  reference  to  Schedule  Control  can  be  seen 
in  the  fact  that  Cost/Schedule  Control  is  one  of  the  two 
most  acute  training  needs  in  the  DoD  today,  according  to  the 
results  of  this  survey  (see  Table  15). 

Project  Management  Institute 

This  study  will  be  used  by  the  Project  Management 
Institute  upon  its  publication.  The  results  of  this  study 
will  be  presented  at  the  PMI  annual  symposium  in  Dallas  TX 
in  late  September  1991.  The  goals  of  the  research  team  for 
the  symposium  are  as  follows: 
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1.  Present  the  DBOK  to  the  PMI  membership  as  a 
validated  foundation  of  the  emerging  Aerospace  and 
Defense  track  in  PMI.  The  DBOK  will  be  recommended  as 
the  basis  of  a  professional  certification  program  for 
Aerospace  and  Defense  project  managers. 

2.  Convince  the  PMI  membership  that  the  PMBOK  must  be 
re-calibrated  with  the  Project  Management  Profession 
through  a  major  revision,  and  that  such  a  revision  will 
be  most  effective  if  the  methodology  and  results  of 
this  study  are  applied  to  the  PMBOK. 

After  presentation  at  the  PMI  symposium,  the  results  of  this 

study  will  be  submitted  for  publication  in  the  Project 

Management  Journal  and  Program  Manager.  DSMC's  acquisition 

management  journal . 

Recommendations  for  Future  Research 

As  any  profession  develops  with  time,  so  must  its 
foundation  and  structure.  The  DBOK  presented  here  is  a 
first  version  thgt  his  been  subjected  to  expert  review,  but 
it  is  not  final  nor  should  it  be.  The  DBOK  must  be  further 
developed  and  continually  subjected  to  professional 
criticism  to  ensure  that  it  remains  valid  and  relevant  to 
the  profession. 

Larger  Project  Management  Profession.  The  profession 
that  will  grow  from  this  DBOK  will  be  most  relevant  and 
applicable  within  the  DoD,  but  it  will  be,  as  its  earlier 
forms  always  have  been,  a  subset  of  the  larger  Project 
Management  Profession.  Recognition  of  this  relationship  by 
DoD  program  managers  and  project  managers  outside  the  DoD 
will  be  the  conduit  through  which  information  and  mutual 
understanding  will  flow  to  benefit  the  whole  profession. 


85 


topendix  A;  Def^e  Program  Managenvent  Body  of  Knowledge 
( Priofiti^^)  ggid  Gl ossary 


LEtoE^IP/PTOSOHAL  ^TT.TJ^ 

Relationship  Development  and  Team 
BUiidihg. 

Ethics 

Persohal  bvmership  and  Conmitment 
Motivation  ^  influence 
P61  iticai/prga^zatipnal 
Awareness/Power 
Lorig-Tem  Perspective 
Action  Orientation 
Asi^ertiv^ess 


SraATECT  AND  PLANNING 

Acquisition  Strategy/ Planning 
Ac^sition  Process 
Statement  of  Work 
Project  Life-Cycle  Analysis 
Managem^t  Information  Systems 
Work  Breakdown  Structure 
Forecasting 
Network  Analysis 


OQgr  MANAGEMENT 

Planning,  Progranming  S 
Budgeting  System 
Cost/Schedule  Control 
Contractor  Financial  Management 
Estimating 

Life  Cycle  Cost  Analysis 
Reprogranming 

Should  Cost/Could  Cost  Analysis 
Project  Accounting 
Design  to  Cost 
Financial  Analysis  of  DoD 
Contractors 
Capital  Investment 


RISK  MANAGEMOIT 

Risk  Identification 
Risk  Ass^sm^t 
Risk  Planning 
Risk  Analysis 
Sources  of  Risk 
Risk  Avoidance 
Value  Analysis 
Unavoidable  Risk 


DEFaiSE  PROGRAM  MANACaffiMT 

Federal /DoD  Acquisition  Policy 
Role  of  Congress  in  the  Acquisition 
Process 

Management  of  Appropriated  Funds 
Competition/Altemate  Sourcing  • 
Federal/DoD  Acquisition 
Organizations 

Joint-Service  Acquisition  Management 
Contractor  Perspectives  on  Business 
Management 

Environmental  Policy  and  Regulations 
International  Project  Management 


MANOBGEMEWT  TECHNIQUES 

Communicating 

Decision  Making 

Organization  and  Staffing 

Training,  Developing  and  Retaining 

Time  Management 

Counseling  and  Evaluating 

Negotiating 

Managing  Meetings 

Controlling 
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LOGISTICS  MBHBGaffiMT 


SySTBiS  EWGIMEERIHG 

trade-off  Analysis 
T^hwcal  Performance  Measurement 
Configxiration  Management 
Integrated  Product  Development 
technical  Review  Process 
Engineering  Change  Procedures 
Pre-Planned  Product  Improvement 
Specifications  and  Standards 
Prpducibility  Engineering  &  Planning 


Integrated  Logistic  Support 
Rel  iabi 1 i ty/Avai 1 abi 1 i ty/ 
Maintainabi 1 ity 
Logistic  Support  Analysis 
Acquisition  Logistics  Management 
Post-Production  Logistic  Support 
Logistics  Test  and  Evaluation 
Contracting  for  Logistic  Support 
Contractor  Support  Planning 


OONTOACT  MMDVGEMEMT 

Contract  Modifications 
Contract  Types 
Source  Selection 
Contract  Administration 
Legal  Aspects  of  Contracting 
Subcontractor/Vendor  Management 
Problem  Remedies 
Disputes  and  Appeals 
Solicitation  Methods 
Warranties 

Government  Support  to  Contractors 


QUALITY  MANACTMEMT 

Total  Quality  Management 
User/Custcmer  Relations 
Quality  Assurance 
Quality  Evaluation  Methods 
Quality  Controls/Standards 
Quality  Costs 
Quality  Theory 


TEST  AND  EVALUATION  MANRGEMEMT 

Test  &  Evaluation  Master  Plan 
Development  TSE 
Operational  TSE 
DoD  TSE  Process 

DoD  TSE  Policies  and  Directives 
Contractor  TSE  Support 


SOFTWARE  MANAGEMENT 

Software  Acquisition 
Software  Testing 

Mission  Critical  Corputer  Resources 
Software  Documentation 
Software  Metrics 
Software  Specifications 
DoD  Policies  and  Regulations 
Software  Maintenance 
Elements  of  Computer  Resources 
Languages 


MANUFACTORIHG  MANAGEMENT 

Transition  from  Development  to 
Production 

The  Production  Review  Process 
Acquisition  Manufacturing  Planning 
Manufacturing  Processes 
Industrial  Modernization  Incentives 
The  Industrial  Review  Analysis 
Inventory  Management 
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GLxsssaiffcr 


A.  gl^T^  Atro  PLaNNIMG 

Work  Breakdown  Stwcture:  A  taskroriented  "family-tree"  of  activities 

wMch  orgamz^,  define ,  and  graphically  displays  the  total  work  to  be 
acconipHsb^  in  order  to  achieve  the  final  objectives  of  the  project. 

It  is  a  system  for  subdividing  a  project  into  manageable  wprk  packages, 
cpitppnents,  or  elements  to  provide  a  common  framework  for  cost/schedule 
cqnmkucatioh^  allocation  of  responsibility,  monitoring  and  management. 

Statement  of  Work:  Description  of  the  actual  work  to  be  performed  on 
the  project,  which,  when  combined  with  the  specifications,  usually  forms 
the  basis  for  contractual  agreement  on  the  project . 

Network  lUialysis:  The  use  of  reciprocal  relationships  to  stabilize  the 
project  wprk,  giving  the  project  predictability  and  synergism.  It  shows 
relationships  between  various  project  tasks  and  events  by  tracking  the 
time  and’ cost  considerations  of  the  project. 

Project  Life^cle  Analysis:  The  determination  of  how  requirements, 
costs,  and  alternatives  will  vary  throughout  the  life  of  the  project. 

Forecasting:  The  work  performed  to  estimate  future  conditions,  costs, 
and  events. 

Management  Information  System:  A  structured,  interacting  carpi  ex  of 
persons,  machines  and  procedures  designed  to  produce  information  which 
is  collected  from  both  internal  and  external  sources  for  use  as  a  basis 
for  decision-making. 

Acquisition  Planning/ Strategy:  Development  of  the  overall  approach  for 
completing  the  project,  including  tailoring  policies,  organizations, 
contracting  arrd  management  strategies  to  meet  project  needs. 

Acquisition  Process:  The  process  of  need  determination,  design, 
development,  testing,  production,  deployment,  logistical  support, 
improvement,  and  retirement  of  a  system. 


B.  OUALITy  MANAGEMENT 

Quality  Assurance:  Managerial  processes  that  provide  all  stakeholders 
evidence  to  establish  confidence  that  the  quality  activities  are 
performed  properly. 

Total  Quality  Managanent:  A  strategy  for  continuously  improving 
performance  at  every  level,  and  in  all  areas  of  responsibility. 
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Q^lity  (^trols/Standards:  The  technical  processes  and  procedures 
hec^sary,  to  ensure  that  each  stage  in  the  life-cycle  of  a  product  is 
performed  in  conformance  vdth  the  requirements  and  quality  plans  in 
order  to  ^ure  that  quality  is  achieved  throughout. 

Q^lity  Coste:  The  explicit  and  inplicit  costs  of  a  poor  quality 
product  or  process,  the  costs  of  quality  programs  and  controls,  and  the 
iTEuniagemmt  which  strives  to  minimize  the  total  of  these  costs. 

QuaHty  Throry:  "Itie  concept  or  idea  of  instilling  quality  and 
reliadsility  into  each  phase  of  project  development. 

Quality  Evaluation  Methods:  The  means  by  which  quality  may  be  measured 
^d  the  means  by  which  the  effectiveness  of  quality  programs  may  be 
tracked. 

User/Customer  Relations:  Activities  to  cultivate  and  maintain 
user/ customer  support  or  the  project  and/or  product. 


C.  POST  MaNAGEMENT 

^timating:  The  process  of  assembling  and  predicting  the  costs  of  a 
project. 

Life  Cycle  Cost  Analysis:  Analyses  based  on  the  total  cost  of  a  system 
or  item  over  its  full  life  which  includes  research  &  development, 
investment,  and  operating  phases,  as  well  as  final  disposal. 

Design- to-Cost:  Tailoring  the  design,  development  and  manufacturing 
process  of  the  project  so  that  the  ultimate  cost  is  equal  to  the  amount 
of  money  available  for  completing  the  project. 

The  Planning,  Programming,  and  Budgeting  System:  A  cyclic  planning  and 
control  process  consisting  of  three  distinct  but  inter-related  phases 
(planning,  programming,  and  budgeting),  which  sets  forth,  in  terms  of 
dollars,  the  "work  plan"  of  all  levels  within  DoD. 

Reprogramming:  The  means  by  which  appropriated  funding  levels  are 
adjusted  according  to  relative  program  shortfalls,  surpluses,  and 
obligation  profiles. 

Cost/Schedule  Control:  A  technique  to  quantitatively  measure  project 
performance  at  a  particular  point  in  the  project  life-cycle.  The  process 
of  monitoring,  evaluating  and  comparing  planned  results  with  actual 
results  to  determine  the  status  of  the  project  cost,  schedule  and 
technical  performance  objectives. 

Contractor  Financial  ManagamMit:  A  contractors  overall  management  of 
its  cashflow  system  to  ensure  that  inflows  exceed  outflows  and  that  the 
firm  ronains  viable  over  time. 
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Financial  i^lysis  of  DoD  Contractors:  Tools  and  techniques  used  by  OSD 
to  ^alyze  the  financial  position  of  defense  contractors,  and  interpre¬ 
tation  of  the  results  of  these  analyses. 

ProjeCT  Accenting:  The  process  of  identifying,  measuring,  recording 
and  cdnmM eating  actual  proj^t  cost  data. 

Capital  liiyiKtineht:  Long-term  financing  of  plant,  property,  and 
.e<^proent. 

Shoiuld  C^t/Could‘  Cost  Analysis: 

Should  Cost:  An  approach  to  contract  pricing  which  examines  a 
contractor's  work  processes  and  identifies  irnprovements  that  should  be 
made  to tfeduce  inefficiencies  thus  lowering  costs. 

Could  Cost:  A  cooperative  effort  between  the  government  and  the 
contractor,  aimed  at  improving  business  metho<fc  and  minimizing  non¬ 
value  added  work. 


D.  RISK  MaNAGEKENT 


lUsk  Planning:  Forcing  organized,  purposeful  thought  towards  the 
subject  of  eliminating,  minimizing,  or  containing  the  effects  of  unde¬ 
sirable  occurrences. 

Risk  Assessment:  Review,  examination,  and  judgement  as  to  whether  or 
not  the  identified  risks  are  acceptable  in  the  proposed  actions. 

Sources  of  Risk:  The  five  types  of  risk  which  must  be  considered  and 
managed  on  a  project.  These  include  technical,  supportability,  program¬ 
matic,  cost  and  schedule  risk. 

Risk  Identification:  The  process  of  identifying,  classifying,  and 
organizing  all  the  risks  likely  to  impact  a  particular  project. 

Risk  Analysis:  The  mathematical  examination  of  the  nature  of  individual 
risk  on  the  project,  as  well  as  potential  structures  of  interdependent 
risk. 

Risk  Avoidance:  Selecting  the  lower  risk  choice  while  still  accomplish¬ 
ing  the  requirements. 

Unavoidable  Risk:  Assessing  that  risk  which  can't  be  controlled  and 
managing  a  program  accordingly. 

Value  Analysis:  A  concerted  effort  to  produce  the  end  item  as  inexpen¬ 
sively  as  possible  without  any  degradation  in  performance  or  quality. 
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t.  -LEKDB^IP/PERSCJWAr.  SKIU^ 

Persc^l  Ownership  &  Cotirdtinent:  Seeing  oneself  as  the  one  responsible 
for  the  overall  success  of  the  program. 

Motivation  &  Influence:  The  process  of  inducing  an  individual  to  work 
towards  achieving  the  organization's  objectives  while  also  working  to 
•achieve  personal  objectives . 

Political/prgrjnizational  Awareness/Power:  Understanding  and 
consideration  of  the  politics  and  power  issues  associated  with  one's  or 
another's  actions. 

Relationship  Development  &  Team  Building:  Developing  a  sense  of 
ownership  and  pride  in  the  project  among  team  members  to  help  ensure 
that  each  team  member  works  towards  the  group  goal  while  achieving 
personal  growth.  .  . 

Action  Orientation:  Reacting  to  problans  energetically  and  with  a  sense 
of  urgency. 

Long-Term  Perspective:  An  orientation  towards  the  long-tenn  success  of 
an  endeavor. 

Ethics:  A  set  of  moral  principals  or  values  that  determine  what  ought 
to  be  done  under  a  given  set  of  circumstances. 

Assertiveness:  The  inclination  to  bold,  positive  expression. 


F.  MANAGEMENT  TECHNIQUES 

Organizing  and  Staffing:  establishing  an  effective  organizational  form 
and  acquiring  the  required  personnel  from  either  within  the  organization 
or  from  outside  sources. 

Training,  Developing  S  Retaining:  The  activities  necessary  to  establish 
and  develop  competent  employees,  and  the  management  necessary  to  keep 
them  effective  on  the  project  and  in  its  future. 

Counseling  S  Evaluating:  The  art  of  providing  periodic  feedback  to  an 
employee  concerning  career  plans,  work  requirements,  and  job 
performance. 

Camwni eating:  The  process  of  formal  and  informal  interactions  of 
individuals  and  groups  on  the  project  team  and  across  organizational 
lines. 

Time  Management:  The  function  required  to  maintain  appropriate  alloca¬ 
tion  of  time  to  the  overall  conduct  of  the  project  throughout  the  stages 
of  it’s  life  cycle  by  means  of  time  planning,  estimating,  scheduling, 
and  controlling. 
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Ni^oitiat^g:  The  process  of  bargaimng  with  individuals  concerning  the 
trar^fer  of  resources,  the  generation  of  infontation,  and  the  accom- 
plisUnOTt  of  activiti^. 

Decision  ^Making:  The  choice  between  alternative  courses  of  action. 

C^trolling:  Directing,  regulating,  or  otherwise  exercising  authority 
or.  influence  over  a  project. 

Managing  Meetings;  Preparing  for,  conducting,  and  following  up  on 
project  related  meetings. 


G.  sysrais  ^iheering 


Trade-Off  Analysis:  Consideration  of  the  relationships  among  availabil¬ 
ity,  reliability,  and  maintainability  when  making  project  decisions. 

Technical  Performance  Measuranent:  The  continuing  demonstration  and 
prediction  of  the  degree  of  actual  or  anticipated  achievement  of  select¬ 
ed  technical  goals  or  objectives  of  a  system  or  part  of  a  system  there¬ 
of,  together  with  causal  analysis  of  the  variance  between  actual  achiev¬ 
ements  and  objectives. 

Technical  Review  Process:  The  assurance  of  timely  and  effective  atten¬ 
tion  to  the  technical  interpretation  of  contract  requirements,  determi¬ 
nation  of  technical  adeqmcy  of  existing  design  and  evaluation  of  its 
requirements  to  satisfy  requirements,  and  determination  of  a  contractors' 
readiness  to  proceed. 

Producibility  Engineering  and  Planning:  The  production  engineering 
tasks  and  production  planning  measures  undertaken  lo  ensure  a  timely  and 
economic  transition  from  the  development  to  the  prciuction  phase  of  a 
program. 

Engineering  Change  Procedures:  The  process  necessar^^  to  justify  and 
initiate  engineering  analysis,  design,  and  final  incorporation  of  a 
change  to  a  baseline  system  design. 

Pre-Planned  Product  Improvements:  An  acquisition  concept  which  programs 
resources  to  accomplish  the  orderly  and  cost-effective  phased  growth  or 
evolution  of  a  system's  capability,  utility,  and  operational  readiness. 
Configuration  Management:  The  engineering  managtment  process  that 
includes  configuration  identification,  configuration  control, 
configuration  status  accounting  and  configuration  au'-its 

Configuration  Management:  Ensuring  that  equipment  or  hardware  meets 
carefully  defined  functional,  mechanical,  and  electrical  requirements 
and  that  any  changes  in  these  requirements  are  rigidly  controlled, 
carefully  identified  and  accurately  recorded. 
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System  Specifications:  The  definitions  of  the  functional  and  physical 
feqi^fem^ts  of  the  coonponents,  subsystems,  or  systems  which  state 
exactly  what  the  compon^t,  subsystem,  or  system  is  supposed  to  do  and 
.  look  like  quantitatively. 

Integrated  ^oduct  DeyeloEment:  A  systematic  approach  to  the 
irit^rated,  concurrent  design  of  products  and  their  related  processes, 
including  manufacturing  and  support. 


H.  TEST  AND  - EVALOATiaS  ■ 

Test  .and  Evaluation  Master  Plan:  A  summary  document  which  is  maintained 
throughout  the  acquisition  life  cycle  of  a  system  to  explain  the  entire 
T&E  program. 

DoD  TSE  Process:  The  occurrence  of  developmental,  operational,  and 
production  acceptance  test  and  evaluation  procedures  as  a  measure  of  the 
progress  of  technical  and  operational  performance  of  a  system  as  it 
matures  during  the  acquisition  process. 

DoD  T&E  Policies  and  Directives:  The  information  and  regulations 
governing  the  conduct  of  DoD  test  and  evaluation  procedures. 

Contractor  T&E  Si;?)port:  Planning  and  providing  for  that  contractor  T&E 
effort  which  is  necessary  for  a  successful  T&E  program. 

Development  T&E:  Testing  that  is  conducted  to  assist  the  engineering 
design  and  development  process  and  to  verify  attainment  of  technical 
performance  specifications  and  objectives. 

Operational  T&E:  Testing  that  is  conducted  to  estimate  a  system's 
operational  effectiveness  and  suitability,  identify  needed 
m^ifications,  and  provide  information  on  tactics,  doctrine, 
organization,  and  personnel  requirements. 


I.  LOGISTICS 

Contracting  for  Logistics  Supp>ort:  Those  activities  necessary  to 
establish  and  imaintain  contracts  for  logistics  support. 

Logistic  Support  Analysis:  Any  analysis  which  results  in  a  decision  on 
the  scope  and  level  of  logistics  support. 

Integrated  Logistic  Support:  A  disciplined,  unified  approach  to  the 
management  and  technical  activities  necessary  to  integrate  support 
considerations  into  system  design,  to  develop, objective  related  support 
requirements,  acquire  required  support,  and  provide  the  required  sup¬ 
port  . 
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Jteq^siti.OT  Logistics  Managan^t:  The  process  of  systematically  identi¬ 
fying;  ^s^sing  logistics  requirenmts  and  alternatives,  analysis, 
edid  resolution- of  integrated  logistics  support  (ILS)  deficiencies,  and 
the  management  of  ILS  throughout  the  acquisition  process. 

Reii^ility/Avaii^ility/Maintainability: 

Reliability:  The  probability  that  an  item  can  perform  its 
intend^; function  for  a  specified  interval  under  stated  conditions. 

Availability:  The  degree  to  which  an  item  is  in  an  operable  and 
•cbnmittable  state. 

Maintaihabii ity ;  The  ability  of  an  item  to  be  retained  in  a 
specified  condition. 

Post-Production  Logistic  Svqpport:  The  activities  necessary  to  insure 
all  required  support  resources  will  be  available  for  the  remainder  of 
the  e^ipment  service  life. 

Contractor  Support  Planning:  Providing  for  future  contractor  support 
based  on  current  expectations . 

Logistics  Test  &  Evaluation!  Determining  the  ability  of  the  present 
logistics  to  support  the  acquisition  of  the  project. 


J.  MANUEACTORING  MflNAGEMEUT 

The  Industrial  Review  i^lysis:  The  analysis  of  industrial  base  capa¬ 
bilities  conducted  to  determine  the  availability  of  production  resources 
required  to  support  a  major  system  production  program. 

the  Production  Review  Process:  The  process  accomplished  to  help  en.sure 
successful  transition  from  development  to  production. 

Acquisition  Manufacturing  Planning:  Evaluation  and  selection  of 
manufacturing  processes,  materials,  production  rates,  and  other  factors 
in  the  manufacture  of  an  iten\. 

Industrial  Modernization  Incentives:  Programs  used  by  the  DoD  to 
encourage  contractors,  subcontractors  and  vendors  to  rrake  capital 
improvements  aimed  at  advancing  manufacturing  technology,  enhancing 
productivity,  reducing  life-cycle  costs,  and  improving  •ruality  air.} 
reliability. 

Transition  from  Development  to  Production:  Those  activitiej  carried  out 
throughout  the  acquisition  life  cycle  which  identify  and  minimize 
production  risks. 

Manufacturing  Processes:  The  activities  which  change  the  form  or 
properties  of  materials  to  give  them  the  physical  and  functional  charac¬ 
teristics  which  are  required  by  the  end  item  design. 
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Inventory  Ms^gement:  Providing  for  and  controlling  the  materials  and 
conpoh^ts  require  to  support  the  manufacturing  rate  and  determination 
of  lot  qu^tities. 


K.-  OOilTRACT  MftMaGEMENT 

Legal  Aspects  of  Contracting:  The  understanding  and  application  of 
F^eral  laws-  and  regulations  that  apply  to  Government  contracting 
activities. 

^urce  Selection;  The  iirpartial,  equitable,  and  corrprehensive 
evaluation  of  conpetitive  proposals  to  ensure  selection  of  a  contractor 
who  will  meet  the  government's  requirements  at  the  best  value. 

Contract  Types:  The  various  forms  of  pricing  or  compensation 
arranganents  between  the  .government  and  contractors  to  ensure  the 
equitable  allocation  of  risk. 

Contract  Administration:  The  responsibility  for  insuring  compliance  f.r 
all  contractual  terms  and  provisions. 

Contract  Modifications:  Changes  tc  the  contract  terms  and  conditions 
that  may  effect  price,  delivery,  or  any  aspect  of  performance. 

Disputes  and  i^iieals:  The  means  by  which  contractors  may  seek  legal 
recourse  against  the  Government ,. and  the  means  by  which  the  Government 
may  defend  itself. 

■Subcontractor /Vendor  Management:  The  management  of  any  supplier, 
distributor,  vendor  or  firm  that  furnishes  supplies  or  services  to,  or 
for,  a  prime  contractor  or  another  subcontractor. 

Government  Sipport  to  Contractors:  The  specific,  direct  support  to 
contractors  which  will  be  furnished  by  the  government  as  part  of  a 
contractual  arrangement. 

Solicitation  Methods;  The  various  ways  in  which  a  contract  may  be 
initiated  by  the  Government  and  the  requirements  governing  the  use  of 
each. 

Problem  Remedies:  Actions  the  Government  iivsy  take  against  a  contractor 
to  Correct  non-performance  under  the  terms  of  a  contract. 

Warranties:  Contractual  requirements  that  minimum  quality,  design, 
and/or  performance  levels  will  be  met,  and  express  conditions  of 
contractor  liability  and  remedies  if  these  levels  are  not  achieved. 


95 


L.  ^ppwbre; 

Software.  Specifications:  .The  precise  and  verifiable  description  ot  the 
characteristics  of  a  software  program. 

Languages:  The  many  forms  of  syntax,  structure,  and  vocabulary  that  are 
us^, to  develop  software  code,  and  the  appropriate  use  of  each. 

Mission.  Cntical  Ccnputer  Resources:  The  acquisition  of  the  conputer 
syst^  involving  intelligence  activities,  cryptological  activities, 
conm^d  and.  control ,  equiE*Tient  that  is  an  integral  part  of  a  V'leapon  or 
weapon,  system,  equipment  critical  to  the  direct  fulfillment  of  mlitary 
or  intelligence  missions,  by  the  project  manager. 

DoD  Software  Policies  and  Regulations:  The  software  regulations  and 
standards  introduced  by  the  US  Government  to  force  discipline  and 
uniformity  itito  the  software  development  process.  • 

Software  Metrics:  The  prediction  and  dannonstration  of  the  degree  of 
achievement  of  selected  technical  goals  or  objectives  of  a  software 
development  project  or  task,  together  with  analysis  of  the  variance 
between  planned  and  actual  achievements. 

Elements  of  Ccmputer  Resources:  The  cotiponents  of  computer  systams  and 
their  functions  (e.g.,  CPU,  R2\M,  compiler,  etc). 

Software  Maintenance:  The  continuing  support  and  upgrades  necessary  to 
keep  a  software  item  in  operational  condition. 

Software  Acquisition:  Accomplishing  the  required  technical , 
administrative,  and  management  activities/  documents  to  acquire  the 
required  software. 

Software  Docunentaticxi:  The  set  of  manuals  and  other  materials 
necessary  for  users,  progranmers,  and  support  staff  to  effectively  use 
and/or  modify  a  particular  software  item. 

Software  Testing:  The  execution  of  a  program  to  show  that  it  worlcs 
and/or  to  find  its  faults. 


M.  DEFENSE  PROGRM  MANAGEMENT 

Federal/DoD  Acqxrlsition  Policy:  The  body  of  statutes,  regulations,  and 
other  directives  that  govern  DoD  acquisition. 

Federal/DoD  Acquisition  Organizations:  The  roles  and  responsibilities 
of  organizations  and  people  involved  in  DoD  acquisition. 
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International  Project/Program  Management:  The  enhancement  of  defense 
ppstur^,  with  other  nations  through  foreign  military  sales,  memoranda  of 
understanding/ agreement ,  data  exchange  agreement/information  exchange 
projects,  industrial  participation,  munitions  licensing  and  foreign 
weapons  evaluation,  ^d  NATO  cooperative  testing  as  well  as  other 
international  agreem^ts. 

Bavirohmental  Policy  and  Regulations:  The  body  of  direction,  unique  to 
the  DoD,  regarding  envirorcnental  protection. 

Managonmt  of  Impropriated  Funds:  The  responsibilities  of  those  who 
obligate  and  spend  funds  appropriated  by  Congress. 

Cointractor  Perspectives  on  Business  Management:  The  understanding  of 
management  practices  and  concerns  which  do  not  apply  directly  to  DoD 
management . 

Joint  Service  Acquisition  Management:  Acquisition  management  utilizing 
the  talents  of,  and  providing  benefits  for,  more  than  one  DoD  agency  or 
military  service  branch. 

Role  of  Congress  in  the  Acquisition  Process:  Understanding  the 
involvement  of  the  U.S,  Congress  in  the  DoD  acquisition  process. 

Ccmpetition/Altemate  Sourcing:  Knowledge  and  application  of  the  set  of 
statutes  and  regulations  which  direct  full  and  open  competition  for 
Government  procurement  contracts,  and  consideration  of  alternatives  to 
procurement  for  satisfying  requirements. 
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The  following  pages  are  a  reproduction  of  the  survey  instrument 
by  PMI  to  validate  the  model  DBOK.  The  format  was  altered  from  the 
.p.rigihai  for  inclusion  here  due  to  type  and  margin  requirements.  The 
actual'  survey  was  distributed  with  a  copy  of  the  glossary  at  Appendix  A; 
the  glossary  is  not  reproduced  here. 
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P.O.  BOX  43  •  DREXEL  HILL  *  PENNSYLVANIA  19026-3190 

215-622-1796  •  FAX  215-622-5640  •  TWX  5101002864 


building  professionalism 
In  project  management ..." 


26  Jul  91 


1.  Please  help  us  in  a  project  that  will  benefit  project  managers  in  both  government  and  industry. 

2.  The  Project  Management  Institute  and  the  Department  of  Defense  arc  working  together  to  develop  a 
common  Project  Management  Body  of  Knowledge  tailored  to  Defense  and  Aerospace  management.  This 
Body  of  Knowledge  will  be  used  to  establish  or  revise  educational,  professional  development,  and 
certification  programs. 

3.  The  Project  Management  Institute  (PMI)  is  a  nonprofit  professional  organization  devoted  to  advancing 
tlte  project  management  swe  of  the  art.  PMI  membership  exceeds  8,000  worldwide  and  continues  to 
grow  in  several  industry  sectors,  including  the  DoD  and  its  contractors. 

4.  Enclosed  is  a  questionnaire  that  asks  your  opinion  about  specific  areas  of  knowledge  required  for  an 
individual  to  become  a  competent  project  manager.  This  survey  is  being  mailed  to  all  DoD  major  program 
diiectorsAnanagcrs  and  deputies  as  well  as  a  random  sample  of  PMI  members  to  gather  the  opinions  of 
the  experts  in  the  field.  Your  cooperation  is  vital  to  the  success  of  this  project  The  results  of  this  study 
will  be  published  in  future  issues  of  Trograra  Manager"  and  the  "Project  Management  Journal." 

5.  PLEASE  TAKE  A  FEW  MINUTES  TO  COMPLETE  THIS  SURVEY.  We  have  enclosed  a 
glossary  that  defines  the  teims  we  use.  Rctiun  the  questionnaire  as  soon  as  possible  in  the  stamped 
addressed  envelope  enclosed.  Keep  the  glossary  unless  you  have  specific  comments  on  how  the  glossary 
can  be  improved. 

6.  Thank  you  for  your  cooperation  and  concern  for  the  profession. 


CURTIS  R.  COOK,  PhD 
Chair,  Acrospacc/Dcfcnsc  Group 
Project  Management  Institute 
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OWEN  C.  GADEKEN,  PhD 
Director  of  Educational  Research 
Defense  Systems  Management  College 


i.  please  rank  the  following  13  najor  areas  according  to  their 
i^prtance  to  program  manager  conpetence,  "1"  being  most  important  and 
”13”  being  least  important,.  (Competence  means  the  level  of 
understanding  that  an  experienced  program  manager  (not  necessarily  the 
Program  Director  or  overall  Program  Manager)  must  possess  in  order  to  be 
effective.  For  exanple,  knowledge  of  a  work  breakdown  structure  means 
being  able  to  generate  one  and  use  it  as  a  management  tool  throughout  a 
program.  Being/able  to  recognize  one  is  not  knowledge.) 


A.  _  STRATEXjY  AND  PLANNING;  The  establishment  of  strategies  for 

effectively  n^aging  both  the  internal  organizational 
environment  and  situations  created  by  the  external  environment. 

Bi  _  QUALITY  MANAGEMENT;  The  conscious  planning,  implementation  and 

control  of  the  policies  and  procedures  to  ensure  conformance  to 
correctly  defined  requirements  satisfying  .customer  needs. 

C.  _  COST  MANAGEMEJIT;  Maintaining  effective  financial  control  over 

the  project. 

D.  _  RISK  MANACjEMEMT;  The  art/science  of  identifying,  analyzing, 

and  responding  to  risk  factors  throughout  the  life  of  a 
project. 

E.  _  LEADERSHIP/PERSOHAL  SKILLS;  Providing  the  vision  and 

motivation  for  the  project  team  to  acMeve  success.  , 

F.  _  MANAGEMENT  TECHNIQUES;  General  management  tools  and  abilities 

•  (,e.g.,  time  management,  personnel  management)  that  can  be 

applied  in  any  management  position. 

G.  _  SYSTEMS  ENGINEERING:  The  annphasis  of  the  various  engineering 

disciplines  required  to  carry  out  the  system  development 
process,  especially  in  the  design  of  the  product  or  system;  the 
engineering  management  of  a  total  system  to  ascertain  and 
maintain  technical  integrity  over  all  the  elements  of  the 
system. 

H.  _  TEST  AND  EVALUATION  MANAGEMBTT:  The  management  of  a  program  to 

verify  that  a  system  meets  specifications  and  dem,oni3t rates  its 
effectiveness  and  suitability. 

I.  _  LOGISTICS:  Management  of  logistic  support  through  acquisition 

logistics  management,  integrated  It^gistic  support,  reliability/ 
availability/  maintainability,  etc. 

.7.  _  MANUFACTURING  MANAGEMENT:  The  technique  of  planning, 

organizing,  directing,  control Hng,  and  integrating  the  ise  of 
people,  money,  materials,  equipment,  and  facilities  to 
accomplish  the  manufacturing  task  economically. 
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uuwukRCT  MZjMBGEMEfrr;  The  fiinction  through  which  necessary 
r^piurces  (incltiding  people,  plant,  equipment  and  materials) 
are  acquired  for  the  project  from  outside  commercial  fitmis. 

SOFTWBRE  MBNaGBffiMT;  Application  of  current  policies, 
practides  and  procedures  to  acquire  software  as  part  of  defense 
programs . 

DEFENSE  PROGRAM  MANAGEMENT;  Knowledge  of  the  unique  defense 
industry  and  defense  department  environment  to  more  effectively 
«T^>ioy  other  project  managatient  competencies , 


oraER: 


OTHER: 


2.  ^ch  of  the  major  areas  from  the  previous  page  is  repeated  below  with 
subcategories.  Please  indicate  the  inportance  of  the  subcategories 
Amder  each  major  area  by  placing  a  "T"  in  the  spaces  next  to  the  top 
THREE  subcategories  and  "B”  in  the  spaces  next  to  the  bottom  THREE 
subcategories.  Add  other  topics  you  feel  are  also  important  in  the 
spaces  provided.  Refer  to  the  attached  glossary  for  term  definitions. 


A.  strategy  and  planning 

^Wbrk  -Bfe^doTO  Structure 
.  Statement  of  Work 

_ Network  Analysis 

_ ^Prbjoct  Life-Cycle  Analysis 

Forecasting 

_ Management  Information  Systems 

_ Acquisition  Strategy/Planning 

_ .Acquisition  Process 


B.  OOALITY  MANAGEMENT 
_^Quality  Assurance 
„_Total  Quality  Management 
'Quality  Controls/Standards 
Quality  Costs 

_ Quality  Theory 

_ Quality  Evaluation  Methods 

_ .User/Customer  Relations 


C.  COST  MANAGEMENT 

__Estimating 

_..Life  Cycle  Cost  Analysis 

_ ^Design  to  Cost 

_ ^Planning,  Programming  & 

Budgeting  System 

_ ^Reprogramming 

_ ^CJost/Schedule  Control 

_ .Contractor  Financial  Management 

_ ^Financial  Alia  lysis  of  DoD 

Contractors 
.._Project  Accounting 
__Capital  Investment 
...Should  Cost/Could  Cost  Analysis 


D.  RISK  MANAGEMENT 


Risk  Planning 
.Risk  Assessment 
.Sources  of  Risk 
.Risk  Identification 
.Risk  Analysis 
.Risk  Avoidance 
.Unavoidable  Risk 
..Value  Analysis 


E.  LEADERSHIP/PERSONAL  SKILLS 

_ ^Personal  Ownership  &  Commitment 

_ .Motivation  &  Influence 

_ ^Pol  itical  /Organi  zational 

.Awareness/  Power 

_ Relationship  Development  S  Team 

Building 

...Action  Orientation 

_ Long-Term  Perspective 

_ ^Ethics 

Assertiveness 


F.  MANAGEMENT  TEaiNICOES 
...Organizing  &  s'taffing 
....Training,  Developing  & 
Retaining 

_ ^iClounseling  &  Evaluating 

_ ^Ccirmunicating 

_ ^Timt?  Managennent 

.Negotiating 
Decision  Making 
..Controlling 
...Managing  Meetings 
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G.  SYSTElg  ENGIHEERIMG 
..  Trade-off  Jtoalysis 
-  -Technical  Performance 
fieasurem^t 

_ ^Technical  Review  Process 

_ ^Producibility  Engineering  & 

Planning 

^.Engineering  Change  Procedures 
.^Pre-Planned  Product  In^rovement 
^Configuration  Management 
.^Specifications  &  Standards 
._^Ihtegrated  Product  Development 


H.  ‘PEST  ftND  EVamATION 

_ Test  &  Evaluation  Master  Plan 

_ DoD  T&E  Process 

._P6D  TSE  Policies  and  Directives 

_ Contractor  T&E  Support 

_ Development  T&E 

.Operational  T&E 


!  •  LCGIgriCS  MflNAGEMENT 

_ ^Contracting  for  Logistics 

Support 

_ Logistic  Support  Analysis 

....Integrated  Logistic  Support 

_ Acquisition  Logistics 

Management 

. Reliability/  Availability/ 

Maintainability 
....Post-Production  Logistic 
Support 

..Contractor  Support  Planning 
_ Logistics  Test  &  Evaluation 


J.  MANOEACTDRING  MANAGEMENT 

_ .The  Industrial  Review  Analysis 

The  Production  Review  Process 
___Acquisition  Manufacturing 
Planning 

_ Industrial  Modernization 

Incentives 

_ Transition  from  Development  to 

Production 

Manufacturing  Processes 
_ Inventory  Management 


K.  CONTRACT  MANAGEMENT 

_ ^Legal  Aspects  of  Contracting 

_ ^Source  Selection 

_ Contract  Types 

—  Contract  Administration 
Contract  Modifications 

_ Disputes  and  Appeals 

_ .Subcontractor/Vendor  Management 

_ Government  Support  to 

Contractors 

_ ^Solicitation  Methods 

....Problem  Remedies 
’Warranties 


L.  SOFTWARE  MANAGEMENT 

_ ^Software  Specifications 

_  .Languages 

_ ^Mission  Critical  Computer 

Resources 

....DoD  Policies  mid  Regulations 
...Software  Metrics 
Elements  of  Computer  Resources 
...Software  Maintenance 
.Software  Acquisition 
..Software  Documentation 
_ ^Software  Testing 
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Mi  .PROCTfflM  MMRGEMENT 

F^eral/DoD  Acquisition  Policy 
.»F^eral/DoD  Acquisition 
Organizations 
:^Intemational  Project 
^Managerpit 

~  .'Environinental  Policy  and 
Ri^lations 

^..ri^agement  of  Appropriated 
E^jnds 

_ Contractor  Perspectives  on 

Business  Managenirat 
^.Joint  Service  Acquisition 
Mainagernent 

_JRole  of  Congress  in  the 
Acquisition  Process 
_ Competition/Altemate  Sourcing 
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3.  We  would  also  like  to  know  how  to  iinprove  the  education  and  tradning 
of  prpgr^  managers.  Please  circle  the  subcategories  below  which 
represent  your  mbst  critical  training  needs.  Next  to  each  circle, 
please  indicate  the  training  method  which  you  feel  would  be  the  most 
effective.  Use  the  following  scale: 


1:  On  the  job  training  (OJT) 

2:  OTO  supplemented  with  printed  or  video  instruction 
materials 
3 :  Short  Course 

4:  Long-term  full-time  education  culminating  in  a  degree 
5:  Other: _ 


A.  STRATEGY  AND  PLMNIWG 

Work  Breakdown  Structure 
Statement  of  Work 
Network  Analysis 
Project  Life-Cycle  Analysis 
Forecasting 

Management  Information  Systems 
Acquisition  PI araung/ Strategy 
Acquisition  Process 

B.  gjALITY  MANAGEMENT 

Quality  Assurance 
Total  Quality  Management 
Quality  Controls/Standards 
Quality  Costs 
Quality  Theory 
Quality  Evaluation  Methods 
User/Customer  Relations 

C.  COST  MANAGEMENT 
Estimating 

Life  Cycle  Cost  Analysis 
Design  to  Cost 

Planning,  Programming  S  Budgeting 
System 

Reprograirming 
Cost/Schedule  Control 
Contractor  Financial  Management 
Financial  Analysis  of  DoD 
Contractors 
Project  Accounting 
Capital  Investment 
Should  Cost/Could  Cost  Analysis 


D.  RISKMM»^®<T 

Risk  Planning 
Risk  Assessment 
Sources  of  Risk 
Risk  Identification 
Risk  Analysis 
Risk  Avoidance 
Unavoidable  Risk 
Value  Analysis 

E.  LEADERSIIIP/PERSONAL  SKILLS 

Personal  Ownership  o  Ccmmtment 
Motivation  Influence 
Political/Organizational  _ 
Awareness/ Power 

Relationship  Development  &  Team 
Building 

Action  Orientation 
Long-Term  Perspective 
Ethics 

Assertiveness 

F.  MANAGEMENT  TECHNIQUES 

Organization  5-  Staffing 

Training,  Developing  &  Retaining 

Counseling  &  Evalviating 

Communicating 

Time  Management 

Negotiating 

Decision  Making 

Controlling 

Managing  Meeting::. 
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G-  SYST^  B^IHEERING 

fradeTof'f  itoalysis 
Tectaicai-  Perfonrance  Measuraiinent 
Tecf^ical  Review  Process 
PrbducibiUty  Engineering  & 
Planning 

.^gineerihg  Change  Procedures 
'Pre-^Plann^  Product  Intproveinent 
Configuration  Managenient 
Specifications  &  Standards 
Integrated  Product  Development 

H.  TEST  m3  EVaLUATIOW 

Test  &  Evaluation .Master  Plan 
Dob  TSE  Process  • 

Dob  TSE  Policies  and  Directives 
Contractor  TSE  Support 
Development  TSE 
Operational  TSE 

I  .  LOGISTICS  MftNRGEMENT 

Contracting  for  Logistics  Support 
Logistic  Support  Analysis 
Integrated  Logistic  Support 
Acquisition  Logistics -Management 
Re 1 i abi 1 i t  y/ Avai lability/ 
Maintainability 

Post-Production  Logistic  Support 
Contractor  Support  Plai-ining 
Logistics  Test  S  Evaluation 

J-  MANDFTiCTURING  MANAGEMENT 

The  Industrial  Review  Analysis 
The  Production  Review  Process 
Acquisition  Manufacturing 
Planning 

Industrial  Modernization 
Incentives 

Transition  frcm  Development  to 
Production 

M..mufacturing  Processes 
Inventory  Management 


K.  aaiTRACT  MAWAGEMEMT 

Legal  Aspects  of  Contracting 
Source  Selection 
Contract  Types 
Contract  Administration 
Contract  Modifications 
Disputes  and  Appeals 
Subcontractor/Vendor  Management 
Government  Support  to  Contractors 
Solicitation  Methods 
Problem  Remedies 
Warranties 

L.  SOFTWARE  MANAGEMENT 

Softv;are  Specifications 
Languages 

Mission  Critical  Computer 
Resources 

DoD  Policies  and  Regulations 
Software  Metrics 
Elements  of  Computer  Resources 
Software  Maintenance 
Software  Acquisition 
Software  Documentation 
Software  Testing 

M.  D1^SE„PRCGRI^MAM(1^ 

Federal /DoD  Acquisition  Policy 
Federal/DoD  Acquisition 
Organizations 

International  Project  Management 
Environmental  Policy  and 
Regulations 

Management  of  Appropriated  Funds 
Contractor  Perspectives  on 
Business  Management 
Joint  Service  Acquisition 
Managanent 

Role  of  Congress  in  the 
Acquisition.  Process 
Compet ition/Al ternate  Sourcing 


'4>  FihaHy,  please  tell  ijs  about  your  position  and  experience  by 
circling  the  best  answer  to  each  question. 


.  A. 


1. 

MILITARY 

:  ,  2. 

CIVIL  -SERVICE 

'  ■  3. 

INDUSTRY 

y 

B.  SERVICE 

1. 

,  « ' 

AIR  FORCE 

3. 

NAVY  5.  NOT  APPLICABLE 

i  2. 

ARMY 

4. 

MARINE  CORPS 

C.  POSITION 

1.  PROGRM  MANAGER/DIRECTOR  3.  PROJECT  MANAGER 

2.  DEPUTY  PROGRAM  MANAGER/DIRECTOR  4.  OTHER _ 

D.  R^/GKME  •  •  '  ■ 

1.  GENERAL  OFFICER  /  SES  3.  OTHER _ 

2.  0-6  /  GM-15 

How  much  defense  management  experience  do  you  have  under  each  category 
below? 

D.  OFERATICMIAL  EXPERIENCE 


1. 

LESS  TIiAN 

ONE 

YEAR 

4. 

11-15  YRS 

9 

1-5  YRS 

5. 

MORE  TIiAN  i.5  ’YEARS 

OPERATIONAL  E:\PERIENCE 

3 , 

6-10  YRS 

STAFF 

I 

1 

1. 

LESS  THAN 

ONE 

YE.AR 

4. 

11-15  'YRS 

2 . 

,  1-5  YRS 

5. 

MORE  THAN  15  YEARS 

STAFF  EXPERIENCE 

3. 

,  6-10  'IRS 
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■E., 

t 

flObUISITION  MMAGEMENT  EXPERIENCE 

(includes  all  acquisition- related 

expefi^de) 

1.  less:  THftN  ONE  YEAR 

4.  11-15  YRS 

2.  1--.5  YRS 

5.  MORE  THAN  15  YEARS 
ACQUISITION  MANAGEMENT 

fe’'  -  ' 

3.  6-10  YRS 

EXPERIENCE 

V  ' 

G. 

PROGRAM  MftNftGER/DIRBCTOR  EXPERIEMCE  (that  portion  of  the  above  spent 

' 

as  rrianager/director  of  a  program) 

1.  LESS  THM^ONE  YEAR 

4.  11-15  YRS 

? 

2.  1-5  YRS 

5.  MORE  THAN  15  YEARS 
MANAGER/DIRECTOR  EXPERIENCE 

« 

3.  6-10  YRS 

i 

K. 

EDUCATION 

Circle  all  appropriate  responses  for  education  completed. 


Bachelors 

Masters 

Doctoral 

Degree 

Degrj^e 

Degree 

.  Business 

'la 

lb 

Ic 

Management 

2a 

2b 

2c 

Liberal  Arts  3a 

3b 

3c 

Engineering 

4a 

4b 

4c 

Science/Math  5a 

5b 

5c 

Other 

_  6a 

6b 

6c 

PROJECT  PHASE 

Which  phase  is 

your  program  in  now? 

i.  CONCEPT 

EXPLORATION 

3 . 

FJLL-SCALE  ENGINEERING  AND 

&  DEFINITION 

MANUFACTURING  DEVELOPMENT 

2 .  DEMONSTRATION/VALIDATION 

4. 

PRODUCTION  AND  DEPLOYMENT 
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g. 

Hovi  m^y  people  work  in  your  program  office? 


1. 

Less 

than  50 

3'. 

100  -  150 

2. 

50  - 

100 

4. 

More  than  150 

K.  JOB  SaTISFRCTION 

In  g^eral  terms,  do  you  consider  yourself  satisfied  with  your  job? 

1.  EXTREMELY  SATISFIED  4.  SOMEWHAT  DISSATISFIED 

2.  SOMEWHAT  SATISFIED  5.  EXTREMELY  DISSATISFIED 

3.  NEITHER  SATISFIED  NOR  DISSATISFIED 


S.  Please' add  any  ccmnents  you  might  have  about  this  survey  or  the 
project  we  are  conducting.  Your  inputs  here  and  above  are  very 
in^.'ortant  to  the  results  of  thi.s  study. 
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Appendix  C:  Sunmat^  of  Respondent  Feedback 


This -Appendix  sunmarizes  the  comments  entered  on  the 
questionnaire  by.  respondents.  The  comments  listed  below  were  chosen  for 
theiir  relevance  to  the  purpose  of  this  research  project  and/or  their 
insight  into  the  unique  den^ds  on  the  director  of  a  Major  Defense 
Acquisition  Program. 


"...it  is  critical  that  we  increase  the  management  and  leadership 
skills  of  our  civilian  base.  GM-15  and  personnel  in  Army  Acquisition 
Corps  must  be  educationally  and  professionally  trained....  The  days 
of  technically  skilled  personnel  rising  to  critical  management 
positions,  without  adequate  management  ability  and  training  are 
pass^.  .■ .  (Army  Acquisition  Corps)  personnel  must  be  elite  and 
likewise  treated  as -such." 


-  Anny  (3d-15 


"I  tried  working  through  the  questionnaire  but  I  don't  think  t.he 
entire  approach  is  well-founded.  Oii  any  given  day  the  priorities 
could  change  markedly.  There  are  too  many  fine  gradations.  Bottom 
line  -  A  good  PM  needs  to  come  equipped  with  a  complete  set  of 
competencies.  I  don't  think  this  approach  will  help  you  approach  the 
truth." 


-  Navy  Rear  Admiral 


"The  position  of  PM  is  very  much  dependent  on  the  quality  of  the  team 
in  your  office.  If  your  employees  are  always  pushing  their  "e.nveitjpe 
of  performarice,"  then  the  boss  has  very  little  to  do  except  direct, 
control,  .'nakfr  visionary  comments,  etc." 


-  .^.rmy  Colonel 
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"You  don't  discuss  the  critical  ability  of  being  able  to  put  up  with 
am  endless  stream  of  watchers  &  critics,  most  of  them  neither 
jmpwledgeable  nor  competent,  nor  the  constant  turmoil  of  most  major 
programs.  Trust  me,  this  is  an  essential  ingredient  in  being  a 
successful  meager  in  DoD  today." 


-Air  Force  Colonel 


"The  real  training  needs  are  for  people  who  are  at  least  conpetent  in 
2\LL  the  areas.  Subject  matter  experts  are  not  scarce,  but  managers 
are  rare  as  hen's  teeth." 

-  Army  CM-15' 


"...(DoD  Acquisition  programs  are)  very  challenging,  but  (managing) 
more  than  one  system  (simultaneously)  causes  different  challenges." 

-  Army  Colonel 


"Oversight  is  still  overly  pervasive  in  the  DoD  acquisition  arena. 
This  will  continue  to  be  true  until  the  "doers"  outnu!Tt)er  the 
"checkers"  and  the  "checkers"  are  technically  qualified  and  held 
accorntable  for  their  reports. 


~  Navy  Captain 


"I  can't  see  a  lot  of  value  to  this  survey.  Projects  are  run/ 
successful  based  on  the  "team's"  ability  to  do  the  things  listed,  not 
just  the  "manager."  The  !T\anager  needs  to  be  smart  enough  to  know 
what  a  good  team  is  but  doesn't  have  to  be  the  expert  in  anything 
e.xcept  practical  judgement,  motivation,  talent  recognition,  (and) 
corrmitment . " 

-Navy  SES 


"I  think  the  answers  to  Question  2  (Subarea  Prioritization)  will 
change  week  to  week  as  the  program  evolves  and  the  latest  hot  rock 
rolls  through  the  door." 


-  Navy  Captain 
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"Su^ey  seems  to  be  well  done.  However,  the  aspects  of  program 
management  that  cause  the  problons  appear  to  have  been  missed.  It  is 
•my.  fipn  conviction  that  our  problems  are  not  with  the  training, 
•ethicS)  experience,  etc  of  the  "acquisition  corps."  There  is  little 
wrong  with  the  majors ,  LtC’s,  (34-13/14's  or  for  that  matter  the  EMs. 
The  root  of  every  problem  is  at  the  general  officer,  SES,  appointee 
level.  Who,  for  instance,  was  supposed  to  be  reading  the  DAES  report 
on'  the  A-12?" 


-  Army  Colonel 


"Takes  too  long  to  con^lete. . .My  first  inclination  was  to  toss  it. 
Most  EMs  I  know,  myself  included,  wouldn't  take  the  time  to  complete 
a  survey  this  involved.  Time  Management!!  Do  you  have  any  idea  how 
many  of  these  surveys  we  get  in  a  year ' s  time??  Too  many ! ! " 

-*  Army  Colonel 
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AFIT  Control  Number  afit/gsm/lsy/91S-5 


AFIT  RESEARCH  ASSESSMENT 


The  purpose  of  this  questionnaire  is  to  determine  the  potential  for  cur¬ 
rent  and  future  applications  of  AFIT  thesis  research.  Please  return 
completed  questionnaires  to:  AFIT/LSC,  Uright-Patterson  AFB  OH 
45433-^583. 

1.  Did  this  research  contribute  to  a  current  research  project? 
a.  Yes  b.  No 


2.  Do  you  believe  this  research  topic  is  significant  enough  that  it  would 
have  been  researched  (or  contracted)  by  your  organization  or  another 
agency  if  AFIT  had  not  researched  it? 

a.  Yes  b.  No 


3.  The  benefits  of  AFIT  research  can  often  be  expressed  by  the  equivalent 
value  that  your  agency  received  by  virtue  of  AFIT  performing  the  research. 
Please  estimate  what  this  research  would  have  cost  in  terms  of  manpower 
and/or  dollars  if  it  had  been  accomplished  under  contract  or  if  it  had 
been  done  in-house. 

Man  Years  ■  _  $ _  ' 


4.  Often  it  is  not  possible  to  attach  equivalent  dollar  values  to 
research,  although  the  results  of  the  research  may,  in  fact,  be  important. 
Whether  or  not  you  were  able  to  establish  an  equivalent  value  for  this 
research  (3  above),  what  is  your  estimate  of  its  significance? 


a.  Highly 

b.  Significant  c.  Slightly 

d.  Of  No 

Significant 

Significant 

Significance 

5.  Comments 

Name  and  firade 


Organization 


Position  or  Title 


Address 


